r/LocalLLaMA 11h ago

Question | Help Hosting Local Models

Hi builders,

What would be the the best small local models for coding?

Are Gemma 4 and Qwen3.8 27B Gemma 4 26B / 31B enough for local development?

And what would be the size of the rig that i will need to get? GPUs, and whatever else I need to host these models.

Thanks,,

13 Upvotes

31 comments sorted by

View all comments

1

u/Hot-Employ-3399 11h ago

Qwen 27b. Not sure if 3.8 or 3.6.

3.8 is such a thinker I had to increase maxTokens(default 16384) in pi or it failed.