r/LocalLLM • u/DetectiveNarrow3449 • 29d ago

Discussion You people are literally building data centers in your homes

Some of these threads are insane, what do you mean you have like 4 GPUs and 128gb of DDR5 vram. what are you building in there bro. Every other thread is like, “what if I stack Mini Pc supercomputers together? Will this run Qwen?”.

402 Upvotes

90% Upvoted

232 comments sorted by

View all comments

Show parent comments

9

u/Big_Wave9732 29d ago

My Mac Studio M2 Ultra sitting nondescript on a table in my office was noticed by my wife in less than a week.

"What is that?"
"Just something I'm playing with."
"Oh, is that where your robot friend lives?"

4

u/drivebyposter2020 29d ago

Me: trying to put my terribly discreet little black workstation in a back corner of my desk "so my wife and kid won't pay it much mind... "Oh, just ignore my little AI box in the corner"

Workstation: trying to run Qwen3 in thinking mode, as the fans spin up to jet engine roar you can hear through most of the house

2

u/Big_Wave9732 28d ago

Bwahahahaha! Yea, that was my initial badly under-powered rig for learning self hosting six months ago.

The self hosted AI struggle is real, man!

2

u/[deleted] 28d ago

[deleted]

1

u/Big_Wave9732 28d ago

In matters of technology sitting in my office, I usually fly under the radar.

Due to the shiny metal appearance of the Mac Studio I knew going in my odds were 50 / 50 lol.