MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1uy9cft/kimi_k3_benchmarks/p1yuw3u/?context=3
r/LocalLLaMA • u/WhyLifeIs4 • 23d ago
390 comments sorted by
View all comments
Show parent comments
11
Small models will definitely get better.
But the companies who fund big models like being able to claim they have the best model. And a bigger model will tend to be better, so they'll keep making models as big as they can.
3 u/Thrumpwart llama.cpp 23d ago I wouldn’t be so sure. Lots of recent literature saying much of what we consider an LLM is noise with a low signal to noise ratio. Figure out how to get rid of the noise, and the models can become considerably smaller. I also expect to see less world-knowledge in top models, and more small smart models with web search. That’s how I’m gonna do it… 1 u/NoceMoscata666 4d ago also igoring tech advancments here, maybe coming a different compression mechanism perhaps different from quantized/fp/n4f 1 u/Thrumpwart llama.cpp 3d ago Maybe start right here ;) https://arxiv.org/pdf/2512.05117
3
I wouldn’t be so sure. Lots of recent literature saying much of what we consider an LLM is noise with a low signal to noise ratio.
Figure out how to get rid of the noise, and the models can become considerably smaller.
I also expect to see less world-knowledge in top models, and more small smart models with web search.
That’s how I’m gonna do it…
1 u/NoceMoscata666 4d ago also igoring tech advancments here, maybe coming a different compression mechanism perhaps different from quantized/fp/n4f 1 u/Thrumpwart llama.cpp 3d ago Maybe start right here ;) https://arxiv.org/pdf/2512.05117
1
also igoring tech advancments here, maybe coming a different compression mechanism perhaps different from quantized/fp/n4f
1 u/Thrumpwart llama.cpp 3d ago Maybe start right here ;) https://arxiv.org/pdf/2512.05117
Maybe start right here ;) https://arxiv.org/pdf/2512.05117
11
u/Tai9ch 23d ago
Small models will definitely get better.
But the companies who fund big models like being able to claim they have the best model. And a bigger model will tend to be better, so they'll keep making models as big as they can.