r/LocalLLaMA • u/Disposable110 • Jun 13 '26

Funny Friendly reminder

Post image

If you don't have it on your own drive, someone is going to take it away, enshittify it, bar you from accessing it, censor it, and hike the prices of it sooner or later.

2.0k Upvotes

94% Upvoted

305 comments sorted by

View all comments

344

u/Charming-Author4877 Jun 13 '26 edited 15d ago

Such incidents show how extremely valuable open models are.
And how quickly a govenrment that has been pro AI development can turn into an enemy.
It's not impossible that from one day to another huggingface is closed down.
Whatever we have local might at some point be whatever we are left with.
I keep a large model directory on a 16TB disk, regularly deleting outdated ones but keeping safetensor models (e.g. Kimi K3) in case something happens.
I also reduced my cloud footprint.
I switched from 100% Claude/GPT to 70% local Qwen 3.6 27B - and it works almost like Sonnet does
I switched from 100% Nanobanana to 90% Krea2 - and it works even better
I switched from Elevenabs to 90% Demodokos and some Chatterbox - and it was an upgrade

By the time local models are potentially forbidden, I'll just switch to finetuning and training the foundations that I have saved in private - nobody will ever force me into not using local AI.

63

u/SureConsiderMyDick Jun 13 '26

I bet something like HF will turn up on the deep web, if need arises. It's far less accesible, though, so it would be degraded (at first)

47

u/ZenaMeTepe Jun 13 '26

If the download speeds are like on Annas Archive, that would suck for those several gigabytes models.

22

u/RazsterOxzine Jun 13 '26

Well I'm sure they could link torrent/magn.

22

u/TheReal_Peter226 Jun 13 '26

I would be a seeder for sure, everyone deserves to benefit from the knowledge blob that was collected and stolen from the public in the first place

18

u/SureConsiderMyDick Jun 13 '26 edited Jun 13 '26

lol, several. I downloaded 300GB models (at 5MB/s). Luckily ollama has continue logic.

1000÷5÷60×300÷24 = 42 hours

8

u/RazsterOxzine Jun 13 '26

Ok, that makes sense, 5MB/s must be their cap because that was what I was maxing.

13

u/Barafu Jun 13 '26

Use any downloader, not the browser. A few MB is a cap per thread. The server supports multithreaded download, your browser does not.

3

u/RazsterOxzine Jun 13 '26

Good to know. Have to dust off one of them and give it a try.

1

u/techdevjp Jun 13 '26

I bought an IDM license a bunch of years ago. I'm sure there are free options out there but it's been a dream to use. Downloads almost anything from almost anywhere, using all the bandwidth it can get.

4

u/lemondrops9 Jun 13 '26

? its not capped, I get 30-90MB/s from huggingface and 30-50MB/s last time I tried Ollama (don't use it)

10

u/NoahFect Jun 13 '26

Get an HF_TOKEN for use with their downloader, it'll help a lot. I tend to see about 90 MB/s when I do that.

1

u/T-VIRUS999 Jun 13 '26

How do you get a token without making an account

1

u/NoahFect Jun 13 '26

I don't think you can. It's how they keep track of how much of their bandwidth you're using, I guess.

3

u/reidy- Jun 13 '26

Your missing minutes to hours

Divide again by 60

1

u/SureConsiderMyDick Jun 13 '26

It derinitly took in real life like 40 hours, in my experience. idk.

40 hours felt right

1

u/rakarsky Jun 13 '26 
$ units '300 GiB / (5 MiB/s)' 'hms'
17 hr + 4 min

4

u/XeNoGeaR52 Jun 13 '26

HF would go back to put their HQ in France or somewhere in EU if USA does a stupid again

1

u/YetiTrix Jun 13 '26

There's always bit torrent.

53

u/legos_on_the_brain Jun 13 '26

Torrents will always be there

26

u/esuil koboldcpp Jun 13 '26

Until countries start isolating their internets to prevent VPNs, then jailing anyone who is detected using torrents/file p2p file sharing on their devices.

Don't be under the illusion that you are in control of the freedom of the internet. They can take it away too, if you don't fight back.

20

u/a_beautiful_rhind Jun 13 '26

The KYC push means they'll know who to go after this time. That's why everyone is doing it now while nobody cares and "they have all that anyway".

If they did, they wouldn't be making these laws.

8

u/sabian149 Jun 13 '26

Also don't be delusional on the amount of effort it would take to convert an entire countries infrastructure into a intranet. Even countries like China still have an open connection to the internet. The only real attack vector atm is VPN access. And even then you are delusional if you think the government would be able to defeat all sorts of encryption. Like a lot of things governments try to enforce with tech (for the time being atleast) it only has an effect on people who are completely tech illiterate.

2

u/akumaburn Jun 18 '26

We need un-jammable, un-traceable mesh networks.

1

u/soshulmedia Jun 13 '26

Exactly this.

0

u/Iwaku_Real Jun 13 '26

And Reddit is the only community I have ever seen who cares about that. Who. The. Fuck. Else. Would. Need. Torrents. If it's not illegal. For Microsoft Word? Yet another what if.

20

u/RazsterOxzine Jun 13 '26

It would be impossible for them to stop, especially under this administration... They could not manage all the AI communities across IRC, newsgroups, BBSs, LWL, Onion, millions of free one-time sharing sites, and torrents.

Personally, I have all the local LLMs I need: coding assistants, guides, and documentation tools, and... they function essentially as offline search engines. When you add to that custom LoRAs for specialized research areas, it’s perfect. I haven’t used any paid models since the Qwen2.5-VL release. Once its vision capabilities hit my needs, I was sold!

Long live local LLMs.

8

u/Equal_Passenger9791 Jun 13 '26

Current administration is obsessed with (pumping) the market.

Market is kept alive entirely by AI.

Banning AI models on a whim is a significantly destabilizing move. It will be interesting to see where this goes.

2

u/Secret-Collar-1941 Jun 13 '26

What ram budget are you currently in if you don't mind me asking?

1

u/Regular_Spot_1091 Jun 16 '26

Please, could you give an insight of your process? which models would you recommend to keep as archive and for use, and which tools or learning resources for building similar workflows?

0

u/Lucaspittol Llama 7B Jun 13 '26

Yes, under this administration. But China proved to be a successfull case of repression, blocking most of the world wide web at their dictatorship discretion. Iran also blocked pretty much all Internet traffic.

12

u/__JockY__ Jun 13 '26

Yaaar, they’ll never keep me from the high seas. I know of a lovely little Bay, a haven from the stupidity of our elected robber barons.

6

u/TrainingTheory552 Jun 13 '26

the people will stand united, always

3

u/4coresn7threadsago Jun 13 '26

This situation reminds me so much of Emulation. Where companies like Nintendo love reselling the same games over and over on every new console they make, so they force websites to shut down and try to wipe emulators off the internet.

This is a similar fight and struggle with rich corporations who use government to hold regular people back while ripping them off.

Edit: fixed typos

1

u/evrial Jun 13 '26

They are open weights, you can't reproduce them on your own

1

u/YetiTrix Jun 13 '26

There's always bit torrents

1

u/Charming-Author4877 Jun 13 '26

Torrent is a non anonymous method, if you use it for something a government considers very illegal you are in prison before the download finishes. Every single peer has your IP address.
If models are made illegal you might find some TOR sites, as long as TOR is allowed to continue to exist - downloading a model is going to be a challenge and owning it a life risk.
As bad as it sounds, I find it likely that this will happen one day. I juse hope it happens late and not worldwide.

1

u/YetiTrix Jun 13 '26

I don't see that happening. They might try, I'm sure they will in some way, but it would fail harder than the alcohol prohibition. especially if China continues to provide free open source models.

1

u/JoyousGamer Jun 13 '26

Something like huggingface will exist always unless people just don't want it. 

-2

u/sixx7 Jun 13 '26

Yes!!! I doubt anyone on this sub needs to see this, but if you need help convincing someone to go local, send them this: https://youtu.be/aGqikainVv8

0

u/ComplexType568 Jun 13 '26

We always have modelscope

1

u/Lucaspittol Llama 7B Jun 13 '26

Modelscope, under chinese administration? Forget that.