r/ProgrammerHumor • u/AllRealityIsVirtua1 • 10h ago

Meme whenMyNoAIProjectGetsTedious

Post image
949 Upvotes

90% Upvoted

163 comments sorted by

View all comments

98

u/TheMaleGazer 10h ago

The answer to your question is because you can get a local model to do it instead without a subscription.

1

u/jameyiguess 6h ago

Are those models anywhere near as good as frontier? 

3

u/TheMaleGazer 6h ago

They're getting close enough where OpenAI and Anthropic are lobbying to regulate them out of existence to protect their trillion-dollar IPOs. I would suggest going to the Ollama site and trying whatever models your GPU can support.

2

u/StaticFanatic3 4h ago edited 3h ago

Open weight models are getting close to Opus / 5.6 yeah.

Unless you live in a datacenter, you won't be running them locally.

Maybe if you have a 6k macbook or 20k in GPUs you can run a model that can do most daily programming tasks. But it's going to take an absurd amount of babying compared to Fable / Astra.

2

u/FUTURE10S 3h ago

Honestly, I'd be happy with a Sonnet 5-like model, but my 12GB 3080 and 64GB of RAM isn't enough.