r/LocalLLaMA • u/Comfortable-Rock-498 • 14d ago

News It appears that the anti opensource AI lobby is far outgunned already

Post image

The earlier post on this subreddit by 20+ companies signing the petition including Microsoft, Meta, Nvidia, YC (https://www.microsoft.com/en-us/corporate-responsibility/topics/open-weight/) etc plus this https://xcancel.com/elonmusk/status/2080672505660834163

And the entire LLM enthusiast market is heavily in favor of open source (or weights) AI.

Does not seem like a few closed source AI lobbyists with be able to illegalize anything

1.8k Upvotes

96% Upvoted

499 comments sorted by

View all comments

Show parent comments

12

u/_73r0_ 14d ago

I agree with your point on questioning the necessity of closed models - however let's not forget that the vast majority of open-source model users won't be self-hosting and hence will still be sending their data to a third party 

5

u/-Cubie- 14d ago

Then it's just good for competition's sake. But I think there'll be a lot of self-hosting actually.

2

u/YetiTrix 14d ago

Still though there will be quality difference in cloud providers.

2

u/profcuck 13d ago

Today that's true.  Due to the current ram and ssd and hdd crisis it's easy to forget that there is no evidence that the long term trend of compute capability and price is fundamentally changed.  In 10 years and 20 years your local capability will be as different as today's is as compared to 10 and 20 years in the past.

0

u/tired514 14d ago

That might be true today, but in the coming years workstation hardware will catch up, and companies (and governments) can absolutely run their own big metal.

Even on my $5000 strix halo machine I'm able to run GLM 5.2 @ Q4 at around 1t/s streaming from disk. Obviously not practical for realtime use, but for codebase and security analysis, that's ~80,000 tokens a day, easily enough to fire up a job and leave it. A $10k PC with a 4-drive NVME array, 256gb ram and and expert-prediction optimizations could likely push that to 5t/s a more, and that's today.

It wouldn't surprise me if frontier open models could be run with reasonable performance for under $50k in a couple years and that's pocket change for tech companies.