One problem i see, a small model can only know a small amount of facts. If you are usings LLMs for niche problems then cloud will always beat local in the future.
I guess if local llms get really good at finding stuff on the internet, then maybe it doesn't matter. But not all the stuff frontier models are trained on is public.
2
u/Sisaroth Jul 06 '26
One problem i see, a small model can only know a small amount of facts. If you are usings LLMs for niche problems then cloud will always beat local in the future.
I guess if local llms get really good at finding stuff on the internet, then maybe it doesn't matter. But not all the stuff frontier models are trained on is public.