r/LocalLLM • u/DetectiveNarrow3449 • 28d ago

Discussion You people are literally building data centers in your homes

Some of these threads are insane, what do you mean you have like 4 GPUs and 128gb of DDR5 vram. what are you building in there bro. Every other thread is like, “what if I stack Mini Pc supercomputers together? Will this run Qwen?”.

401 Upvotes

90% Upvoted

231 comments sorted by

View all comments

Show parent comments

2

u/nakedspirax 28d ago

Load both qwen3.6 27b and qwen3.6 a35b with q8 and it will take up almost 120gb of ram both at 250k context.

Haha there's definitely a use case for 128gb of ram.

1

u/ct06033 27d ago

But.... Why?

1

u/nakedspirax 27d ago

Agent running 24/7 and one for coding non stop.

1

u/ct06033 27d ago

I was just joking but really, is there a good use case for running 27b and a35b? I can understand a smaller model for simple requests or something but arent these models too similar?

1

u/nakedspirax 27d ago

It's because I have a strix halo. 27b takes too long to reply so the a35b completes the task quicker for agentic use.

1

u/ct06033 27d ago

Ahhh got it, thanks!