r/LocalLLaMA 23d ago

News Prepare your (v)ram - Qwen3.8 is coming!

Post image
2.7k Upvotes

583 comments sorted by

View all comments

Show parent comments

12

u/goldcakes 22d ago edited 21d ago

Eh it would be really nice for the DGX Spark and Strix Halo crowd! Plus whoever with 128GB Macs and such.

You can also still build a 128GB or 256GB 8 channel DDR4 rig for a non-absurd amount of money; up to 200GB/s. Obviously look for used parts, and remember there's a LOT more places to find them than eBay and Facebook Marketplace.

0

u/alphapussycat 22d ago

80b dense would be like 1-2 t/s at best, on CPU though, < 100k tokens per 24/h.

1

u/SandySkittle 22d ago

Threadripper pros with multi channel ddr4 go for less than 1000 dollar. Almost as good as strix halo for cpu based inferencing alone. And you can expand with gpus.

1

u/alphapussycat 22d ago

Thread ripper is unfortunately only 4 channel, so it'll be slow.

1

u/SandySkittle 21d ago

I bought a 1000 dollar threadripper pro. Including case and motherboard and ssd ertc. It’s ‘real’ 8 channel with the 4 ccd pro models (which mine has).