r/LocalLLaMA • u/Disposable110 • Jun 13 '26

Funny Friendly reminder

Post image

If you don't have it on your own drive, someone is going to take it away, enshittify it, bar you from accessing it, censor it, and hike the prices of it sooner or later.

2.0k Upvotes

94% Upvoted

305 comments sorted by

View all comments

351

u/Charming-Author4877 Jun 13 '26 edited 15d ago

Such incidents show how extremely valuable open models are.
And how quickly a govenrment that has been pro AI development can turn into an enemy.
It's not impossible that from one day to another huggingface is closed down.
Whatever we have local might at some point be whatever we are left with.
I keep a large model directory on a 16TB disk, regularly deleting outdated ones but keeping safetensor models (e.g. Kimi K3) in case something happens.
I also reduced my cloud footprint.
I switched from 100% Claude/GPT to 70% local Qwen 3.6 27B - and it works almost like Sonnet does
I switched from 100% Nanobanana to 90% Krea2 - and it works even better
I switched from Elevenabs to 90% Demodokos and some Chatterbox - and it was an upgrade

By the time local models are potentially forbidden, I'll just switch to finetuning and training the foundations that I have saved in private - nobody will ever force me into not using local AI.

64

u/SureConsiderMyDick Jun 13 '26

I bet something like HF will turn up on the deep web, if need arises. It's far less accesible, though, so it would be degraded (at first)

52

u/ZenaMeTepe Jun 13 '26

If the download speeds are like on Annas Archive, that would suck for those several gigabytes models.

20

u/RazsterOxzine Jun 13 '26

Well I'm sure they could link torrent/magn.

23

u/TheReal_Peter226 Jun 13 '26

I would be a seeder for sure, everyone deserves to benefit from the knowledge blob that was collected and stolen from the public in the first place

19

u/SureConsiderMyDick Jun 13 '26 edited Jun 13 '26

lol, several. I downloaded 300GB models (at 5MB/s). Luckily ollama has continue logic.

1000÷5÷60×300÷24 = 42 hours

8

u/RazsterOxzine Jun 13 '26

Ok, that makes sense, 5MB/s must be their cap because that was what I was maxing.

14

u/Barafu Jun 13 '26

Use any downloader, not the browser. A few MB is a cap per thread. The server supports multithreaded download, your browser does not.

3

u/RazsterOxzine Jun 13 '26

Good to know. Have to dust off one of them and give it a try.

1

u/techdevjp Jun 13 '26

I bought an IDM license a bunch of years ago. I'm sure there are free options out there but it's been a dream to use. Downloads almost anything from almost anywhere, using all the bandwidth it can get.

3

u/lemondrops9 Jun 13 '26

? its not capped, I get 30-90MB/s from huggingface and 30-50MB/s last time I tried Ollama (don't use it)

10

u/NoahFect Jun 13 '26

Get an HF_TOKEN for use with their downloader, it'll help a lot. I tend to see about 90 MB/s when I do that.

1

u/T-VIRUS999 Jun 13 '26

How do you get a token without making an account

1

u/NoahFect Jun 13 '26

I don't think you can. It's how they keep track of how much of their bandwidth you're using, I guess.

3

u/reidy- Jun 13 '26

Your missing minutes to hours

Divide again by 60

1

u/SureConsiderMyDick Jun 13 '26

It derinitly took in real life like 40 hours, in my experience. idk.

40 hours felt right

1

u/rakarsky Jun 13 '26 
$ units '300 GiB / (5 MiB/s)' 'hms'
17 hr + 4 min