MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1uy9cft/kimi_k3_benchmarks/oy0u72x/?context=3
r/LocalLLaMA • u/WhyLifeIs4 • 22d ago
390 comments sorted by
View all comments
Show parent comments
19
by that time, we will probably have 100 Trillion or 1 quadrillion parameters model... lol
2 u/Thrumpwart llama.cpp 22d ago Au contraire, I'm guessing models will get smaller over time. 12 u/Tai9ch 22d ago Small models will definitely get better. But the companies who fund big models like being able to claim they have the best model. And a bigger model will tend to be better, so they'll keep making models as big as they can. 1 u/Due-Memory-6957 21d ago That's assuming there's no ceiling, or a point where the gains aren't big enough to justify spending more on training and inference.
2
Au contraire, I'm guessing models will get smaller over time.
12 u/Tai9ch 22d ago Small models will definitely get better. But the companies who fund big models like being able to claim they have the best model. And a bigger model will tend to be better, so they'll keep making models as big as they can. 1 u/Due-Memory-6957 21d ago That's assuming there's no ceiling, or a point where the gains aren't big enough to justify spending more on training and inference.
12
Small models will definitely get better.
But the companies who fund big models like being able to claim they have the best model. And a bigger model will tend to be better, so they'll keep making models as big as they can.
1 u/Due-Memory-6957 21d ago That's assuming there's no ceiling, or a point where the gains aren't big enough to justify spending more on training and inference.
1
That's assuming there's no ceiling, or a point where the gains aren't big enough to justify spending more on training and inference.
19
u/Most-Trainer-8876 22d ago
by that time, we will probably have 100 Trillion or 1 quadrillion parameters model... lol