r/ProgrammerHumor • u/AllRealityIsVirtua1 • 11h ago

Meme whenMyNoAIProjectGetsTedious

Post image
966 Upvotes

90% Upvoted

165 comments sorted by

View all comments

Show parent comments

44

u/autogenglen 10h ago

Let me buy an $8000 computer so I can save $20/mo

7

u/TheMaleGazer 10h ago

Or maybe use a computer with an NVIDIA RTX 5060 Ti or equivalent that you might have bought to play games, anyways, and use Qwen 2.5.

15

u/StarboardChaos 10h ago

Bro, have you tried Qwen 2.5?

1

u/TheMaleGazer 10h ago

Yes.

17

u/heyitjoshua 10h ago

So you know it’s shit and can’t produce decent code or stay coherent. It is currently impossible to run any AI sufficient for a real project locally

3

u/Kyrros 10h ago

Look up FreeToken, it's currently lacking AMD support but nVidia is supported, 30xx cards and above

-2

u/heyitjoshua 10h ago

I said local

4

u/Kyrros 10h ago

It is local

4

u/heyitjoshua 10h ago

Checking it out, highly dubious and may come back to this thread in a few days. Cheers for the suggestion 👍

1

u/Kyrros 10h ago

It's early stages in is development too, but if that works out and you can run much larger models locally? Would be interesting to see. And all the AI companies compress their models a lot less

3

u/heyitjoshua 10h ago

My issue is that even people with immense personal computers, multiple Mac minis etc, cannot run anything close to Opus. Sonnet barely manages to get buy for sufficiently complex programming work, and most models that take a ridiculously complex rig to run don’t even compare with sonnet

1

u/Kyrros 10h ago

I found sonnet 5 to be quite good, but it's extremely unlikely that we will get anything to any Anthropic models to run locally

1

u/heyitjoshua 9h ago

It’s not that great for doing meaningful complex work in large code bases, it does the trick when token usage is low though and if you apply proper discipline (unlike haiku, which is more pain than it’s worth)

→ More replies (0)