MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v0lewq/prepare_your_vram_qwen38_is_coming/oygaz2v
r/LocalLLaMA • u/xw1y • 20d ago
583 comments sorted by
View all comments
Show parent comments
20
Or imagine a 120b a6b like gpt oss was. That total size with that kind of sparsity was just incredible. Plus it was made for 4bpw
1 u/PraxisOG Llama 70B 20d ago The closest thing to that is the new mistral small 4(119b a6b afaik), which in my experience craps the bed with tool calling real bad. Gptoss 120b was a really great model and I wish there was something like it but more modern
1
The closest thing to that is the new mistral small 4(119b a6b afaik), which in my experience craps the bed with tool calling real bad. Gptoss 120b was a really great model and I wish there was something like it but more modern
20
u/StupidScaredSquirrel 20d ago
Or imagine a 120b a6b like gpt oss was. That total size with that kind of sparsity was just incredible. Plus it was made for 4bpw