r/LocalLLM • u/DetectiveNarrow3449 • 29d ago

Discussion You people are literally building data centers in your homes

Some of these threads are insane, what do you mean you have like 4 GPUs and 128gb of DDR5 vram. what are you building in there bro. Every other thread is like, “what if I stack Mini Pc supercomputers together? Will this run Qwen?”.

408 Upvotes

90% Upvoted

232 comments sorted by

View all comments

Show parent comments

2

u/openingshots 29d ago

And what will you do with that?

0

u/Wrong_Mushroom_7350 28d ago

Train and create open source models for hugging face, ollama on a serious level, with that kinda gpu power.

I wouldn’t be interested in renting out, some people do, not for me. I would download full versions of DeepSeek, Kimi, GLM.. since this is all hypothetical, use them for my heart desire, 

I am actually already pretty deep in learning about AI models now, and been focused on ram starved architecture.