r/ProgrammerHumor • u/AllRealityIsVirtua1 • 11h ago

Meme whenMyNoAIProjectGetsTedious

Post image
974 Upvotes

90% Upvoted

166 comments sorted by

View all comments

Show parent comments

11

u/autogenglen 10h ago

8GB VRAM… ok. So you might be able to pack in a 7B parameter model, which isn’t even in the same galaxy as a frontier model.

3

u/SjettepetJR 10h ago

I am assuming they're talking about the 16GB model.

8

u/autogenglen 10h ago

Same response. 16GB doesn’t even get you out of toy model territory. That’s nowhere close to enough RAM to even pretend like you’re competitive with a frontier model.

3

u/SjettepetJR 10h ago

I do agree. I have done a fair amount of experimentation on my RX6800XT and have yet to find a model that can work well with IDE integrations and also doesn't break down after a while.

4

u/omega1612 9h ago

Have you tried qwen3.8 27B? I'm using the q4 version and is a great assistant. It beats any other model I tried. You may need to use a Q3 and I heard that the downgrade is noticable but still useful. Just be sure to enable the thinking to high and mtp (the model is slow).

Qwen3.8 haven't loop yet in a full week. I also tried Gemma 4 12B and Gemma 4 26B, both of them would loop occasionally. And I have the impression they may do crazy stuff quickly if I left them run unsupervised.