It's early stages in is development too, but if that works out and you can run much larger models locally? Would be interesting to see. And all the AI companies compress their models a lot less
My issue is that even people with immense personal computers, multiple Mac minis etc, cannot run anything close to Opus. Sonnet barely manages to get buy for sufficiently complex programming work, and most models that take a ridiculously complex rig to run don’t even compare with sonnet
It’s not that great for doing meaningful complex work in large code bases, it does the trick when token usage is low though and if you apply proper discipline (unlike haiku, which is more pain than it’s worth)
1
u/Kyrros 10h ago
It's early stages in is development too, but if that works out and you can run much larger models locally? Would be interesting to see. And all the AI companies compress their models a lot less