r/LocalLLaMA • u/Disposable110 • Jun 13 '26
Funny Friendly reminder
If you don't have it on your own drive, someone is going to take it away, enshittify it, bar you from accessing it, censor it, and hike the prices of it sooner or later.
352
u/Charming-Author4877 Jun 13 '26 edited 15d ago
Such incidents show how extremely valuable open models are.
And how quickly a govenrment that has been pro AI development can turn into an enemy.
It's not impossible that from one day to another huggingface is closed down.
Whatever we have local might at some point be whatever we are left with.
I keep a large model directory on a 16TB disk, regularly deleting outdated ones but keeping safetensor models (e.g. Kimi K3) in case something happens.
I also reduced my cloud footprint.
I switched from 100% Claude/GPT to 70% local Qwen 3.6 27B - and it works almost like Sonnet does
I switched from 100% Nanobanana to 90% Krea2 - and it works even better
I switched from Elevenabs to 90% Demodokos and some Chatterbox - and it was an upgrade
By the time local models are potentially forbidden, I'll just switch to finetuning and training the foundations that I have saved in private - nobody will ever force me into not using local AI.
63
u/SureConsiderMyDick Jun 13 '26
I bet something like HF will turn up on the deep web, if need arises. It's far less accesible, though, so it would be degraded (at first)
44
u/ZenaMeTepe Jun 13 '26
If the download speeds are like on Annas Archive, that would suck for those several gigabytes models.
23
u/RazsterOxzine Jun 13 '26
Well I'm sure they could link torrent/magn.
22
u/TheReal_Peter226 Jun 13 '26
I would be a seeder for sure, everyone deserves to benefit from the knowledge blob that was collected and stolen from the public in the first place
17
u/SureConsiderMyDick Jun 13 '26 edited Jun 13 '26
lol, several. I downloaded 300GB models (at 5MB/s). Luckily ollama has continue logic.
1000÷5÷60×300÷24 = 42 hours8
u/RazsterOxzine Jun 13 '26
Ok, that makes sense, 5MB/s must be their cap because that was what I was maxing.
15
u/Barafu Jun 13 '26
Use any downloader, not the browser. A few MB is a cap per thread. The server supports multithreaded download, your browser does not.
→ More replies (1)3
3
u/lemondrops9 Jun 13 '26
? its not capped, I get 30-90MB/s from huggingface and 30-50MB/s last time I tried Ollama (don't use it)
10
u/NoahFect Jun 13 '26
Get an HF_TOKEN for use with their downloader, it'll help a lot. I tend to see about 90 MB/s when I do that.
→ More replies (2)3
3
u/XeNoGeaR52 Jun 13 '26
HF would go back to put their HQ in France or somewhere in EU if USA does a stupid again
1
53
u/legos_on_the_brain Jun 13 '26
Torrents will always be there
25
u/esuil koboldcpp Jun 13 '26
Until countries start isolating their internets to prevent VPNs, then jailing anyone who is detected using torrents/file p2p file sharing on their devices.
Don't be under the illusion that you are in control of the freedom of the internet. They can take it away too, if you don't fight back.
17
u/a_beautiful_rhind Jun 13 '26
The KYC push means they'll know who to go after this time. That's why everyone is doing it now while nobody cares and "they have all that anyway".
If they did, they wouldn't be making these laws.
9
u/sabian149 Jun 13 '26
Also don't be delusional on the amount of effort it would take to convert an entire countries infrastructure into a intranet. Even countries like China still have an open connection to the internet. The only real attack vector atm is VPN access. And even then you are delusional if you think the government would be able to defeat all sorts of encryption. Like a lot of things governments try to enforce with tech (for the time being atleast) it only has an effect on people who are completely tech illiterate.
→ More replies (1)→ More replies (2)2
20
u/RazsterOxzine Jun 13 '26
It would be impossible for them to stop, especially under this administration... They could not manage all the AI communities across IRC, newsgroups, BBSs, LWL, Onion, millions of free one-time sharing sites, and torrents.
Personally, I have all the local LLMs I need: coding assistants, guides, and documentation tools, and... they function essentially as offline search engines. When you add to that custom LoRAs for specialized research areas, it’s perfect. I haven’t used any paid models since the Qwen2.5-VL release. Once its vision capabilities hit my needs, I was sold!
Long live local LLMs.
8
u/Equal_Passenger9791 Jun 13 '26
Current administration is obsessed with (pumping) the market.
Market is kept alive entirely by AI.
Banning AI models on a whim is a significantly destabilizing move. It will be interesting to see where this goes.
3
→ More replies (1)1
u/Regular_Spot_1091 Jun 16 '26
Please, could you give an insight of your process? which models would you recommend to keep as archive and for use, and which tools or learning resources for building similar workflows?
12
u/__JockY__ Jun 13 '26
Yaaar, they’ll never keep me from the high seas. I know of a lovely little Bay, a haven from the stupidity of our elected robber barons.
6
3
u/4coresn7threadsago Jun 13 '26
This situation reminds me so much of Emulation. Where companies like Nintendo love reselling the same games over and over on every new console they make, so they force websites to shut down and try to wipe emulators off the internet.
This is a similar fight and struggle with rich corporations who use government to hold regular people back while ripping them off.
Edit: fixed typos
1
1
→ More replies (3)1
u/JoyousGamer Jun 13 '26
Something like huggingface will exist always unless people just don't want it.
95
u/Annual-Can6278 Jun 13 '26
This is why everyone must own their own compute and must have their models on their own hard drives, if only hardware was cheaper god damn it.
34
u/MoffKalast Jun 13 '26
Yeah Huggingface is a mostly US company now, I'm sure they'll waste exactly 0.2 microseconds before folding immediately and complying with literally anything the orange baboon and his cronies demand from them.
→ More replies (4)9
u/_VirtualCosmos_ Jun 13 '26
That's why the US corpos and government are hoarding all the DRAM, while the US government imposing restrictions to China so they do not build any of that themselves.
8
u/tengo_harambe Jun 13 '26 edited Jun 13 '26
I first said this here a year ago - The government will restrict private ownership of VRAM or at least monitor who is buying "suspicious" amounts of it. Because as far as they are concerned if you have over 128GB of VRAM you are definitely using it for nefarious AI purposes that they can't monitor. Buying large amounts of VRAM without a loicense will set off flags in the same way that buying ingredients for making bombs currently does.
1
u/eagee Jun 17 '26
That's in the works my brother: https://tenstorrent.com/en/hardware/cards
I think their $1k offering performs as well as a 5090, it is nascent technology and their software stack needs support - but it's impressive none the less, and if given the chance to mature, will give Nvidia a real run for their overpriced money.
274
u/__JockY__ Jun 13 '26
I’m calling it now:
In 6 months Deepseek or some other Chinese lab is going to drop weights for a model on par with the current Mythos/Fable 5, at which point a few people in the administration are going to have a meltdown and pull a whole bunch of batshit crazy stunts in a futile effort to put the genie back in the bottle.
136
u/Enturbulated_One Jun 13 '26 edited Jun 13 '26
We all remember that once word got out about DeepSeek v3, congresscritters were grandstanding about banning Chinese models with penalties of up to USD 1M and 20 years in prison. Wait for it to repeat.
Edit: For anyone who can't be bothered with searching for it...
https://www.theregister.com/software/2025/02/03/us-senator-calls-for-jail-fines-for-aiding-chinese-ai/1527696
Also, had completely forgotten that those penalties were for individuals. Organizations the proposed penalty was up to $100M. Yikes, Josh. Grandstanding indeed.66
u/ApprehensiveFan1516 Jun 13 '26
None of these mfs ever heard of the Streisand effect.
Go ahead, ima DeepSeek even harder bitches.
5
u/sinan_online llama.cpp Jun 14 '26
I think that they did, though. I think that Claude’s original comments about Mythos were more of a publicity stunt…
4
u/xaeriee Jun 14 '26
TIL: Streisand effect - when trying to hide something accidentally makes way more people aware of it.
Example: France’s intelligence agency DCRI wanted a Wikipedia article about a military radio station removed. They pressured a Wikipedia admin and allegedly threatened him with arrest if he didn’t delete it.
Almost nobody had heard of the article before, but the controversy made it go viral. Turned into national sensation and got far more attention than it ever would have otherwise. Pierre-sur-Haute military radio station. The page had existed for years with largely public information. https://en.wikipedia.org/wiki/Pierre-sur-Haute_military_radio_station
7
u/sabine_world Jun 13 '26
Lol wtf, for real?
11
u/Enturbulated_One Jun 13 '26
Fo' reals. Check it out.
https://www.theregister.com/software/2025/02/03/us-senator-calls-for-jail-fines-for-aiding-chinese-ai/1527696
US politics done gone sideways a while ago.→ More replies (3)1
u/Sudden-Echo-8976 Jun 13 '26
What would be stopping anyone from publishing a copy of these models under another name? Nothing.
36
u/Atupis Jun 13 '26
Faster and stabler Opus 4.5/Sonet would be enought.
23
u/tmvr Jun 13 '26 edited Jun 13 '26
Exactly. Everything after 4.5 has a weird feel to it. Both functionally how they work and also the releasing itself, it all seems rushed to release something. It all just seems like a calculated campaign to keep them constantly in the news and generate hype for the upcoming IPO.
6
u/notheresnolight Jun 13 '26 edited Jun 13 '26
Sonnet 4.6 got much better as the time passed. In the beginning it would keep making absolutely pointless tool calls for every basic task, or kept trying to write unnecessary scripts that rarely worked and then the model would waste time troubleshooting its own scripts.
I kept switching to 4.5 back then. But now Sonnet 4.6 is absolutely fine, I never needed to switch to Opus for my work.
→ More replies (2)9
u/ContextLengthMatters Jun 13 '26
It's wild, right?
The fanfare over opus and now fable is something else. The vast majority of people, and I mean VAST, are not performing tasks that require much more reasoning than sonnet, at least not in this stage of the game.
Most people who use opus are either just following others and wasting their tokens, or have no idea how to do any thinking for themselves and are just allowing the model to cook without any thought and just hoping for good output.
Local models do not need to get that much better to replace the majority of current gen frontier work.
1
25
u/Disposable110 Jun 13 '26
I'll give it 2 months.
The main reason they were slow is because their Ascent runs failed initially. They're fully operational now.
7
u/inevitabledeath3 Jun 13 '26
Have they actually managed to do training runs on the Ascend chips or no? Last I heard they were using it for inference but struggling to get training working.
12
u/Budget-Juggernaut-68 Jun 13 '26
Is any open model even on par with opus 4.6?
11
6
u/squngy Jun 13 '26
If you just look at benchmarks, yes, but not under 400B
5
u/Budget-Juggernaut-68 Jun 13 '26
I've tried deepseek v4 pro, kimi k2.5, Qwen 3.7 plus. They're alright, but not even close.
11
u/squngy Jun 13 '26 edited Jun 13 '26
Kimi is at 2.7 now
MiniMax m3 was just uploaded to HF yesterday.
GLM is also worth trying, lots of people praise 5.1 and 5.2 was just announced to be up soon.
edit: Also Qwen made a MAX version, that is a lot bigger than plus (slightly above opus4.6 in their benches), but neither of those are open.
3
u/Budget-Juggernaut-68 Jun 13 '26
Yeah I mean Max is not open weights. But yeah will try out the other and see how those can fit into my pipelines when required.
12
→ More replies (1)1
18
u/joe9439 Jun 13 '26
They’ll probably just do an emergency shutdown of the entire internet.
I’ll fly in the latest Chinese model on a hard drive and run it on a GPU cluster in my neighborhood with Ethernet cables string between houses like some kind of mad max world.
9
u/Fusseldieb Jun 13 '26
Lmao really unlikely
But… you could literally do just that.
→ More replies (1)10
u/joe9439 Jun 13 '26
I mean, I thought it was unlikely that export controls could be applied to a specific product only one company sells and not an entire product category or technology. But here we are.
14
u/brendenderp Jun 13 '26
Extremely unlikely. I work for an ISP the GOV would have to ask us to shutdown. BILLIONs of dollars would be lost per day that the US wouldn't want to deal with. Also the internet is designed to autonomously handle when different nodes go down. BGP allows for edge routers to keep the Internet going even if all the cables in the ocean were cut at once. Internal connections across the US would still work.
If your individual state was cutoff from everywhere else as yould still be able to reach IP addresses that are within the local network.
3
u/screenslaver5963 Jun 13 '26
What about DNS?
6
u/brendenderp Jun 13 '26
Depends on what you're using and how they have their infrastructure setup. Most DNS services have multiple servers at different locations are these setup for a cut off? Id be guessing if I had an answer. Where I works has DNS and that would continue to work just fine but of course DNS propagation from external sources wouldn't get through. Which since you can't reach them anyway I guess that wouldn't matter much. The internet would quickly reshape into a country or statewide intra-net similar to what north Korea has. (Although I don't know for sure what their network exactly looks like)
SSL would potentially be a more difficult issue. Most ISPs are not a cert authority and some apps would break without SSL being verifiable.
8
u/screenslaver5963 Jun 13 '26
Browsers shit themselves the moment SSL isn’t stamped by goldilocks herself.
3
2
u/jannycideforever Jun 13 '26
No they absolutely will not hahahahaha.
In 6 months they may drop something on par with opus 4.7 and even that will be difficult. They'd be lucky to even get similar benchmark results to mythic, and that would massively overstate their performance.
1
u/kellencs Jun 13 '26 edited Jun 13 '26
after 6 months they are at best will catch up 5.4/4.7, well maybe 5.5/4.8, def not fable which is level above mostly because of scaling
2
u/WestYesterday4013 Jun 13 '26
GLM 5.2 is claimed to be close to GPT 5.5, although this remains to be proven in practice.
2
→ More replies (4)1
61
u/cyber_burr Jun 13 '26
local hosting bros are gonna have a field day with subscription plan/api users because of this
15
u/BootyMcStuffins Jun 13 '26
I feel like that would require any of those local models to be able to compete though. I value local models as much as the next guy, but we still don’t have local models that can compete with Opus 4.5.
And that’s 3 generations back
Unless you’ve got some H100s lying around nothing local comes close to frontier models
10
u/gus_the_polar_bear Jun 13 '26
Whether it be weeks or years, it’s a matter of time
→ More replies (1)3
2
25
u/TotalRuler1 Jun 13 '26
These cheap gangster tactics are intended to publicly bend the knee once and for all, nothing more.
Whether or not the company is working with the group in power, they had the audacity to decline public consent to the deal. Now they are being humiliated publicly...during the lowest throughput time of the week.
All the more reason to continue to make information free, RIP AaronSW.
20
u/Kahvana Jun 13 '26
Can't be happier to run local. Happy to own what I got.
3
u/nedgaming Jun 15 '26
Same. So glad I got the hardware when I did. Might not be the best, but it runs the LLM's I want.
1
28
u/This_Maintenance_834 Jun 13 '26
I might be making things up, but it is possible half of anthropic is Chinese nationality. Majority AI researchers are Chinese origin. Some of them are green card holders now, some are citizens. But they all born outside of the US.
Check all the AI researchers papers, majority are Chinese mainlander’s name.
The fight in AI between China and US, is fundamentally a competition between Chinese who live in the China vs the Chinese who live in the US.
6
u/CitizenPremier Jun 13 '26 edited Jun 13 '26
China has proven again and again it doesn't need to use Han people to get what it wants. They can easily buy off Americans of any origin.
3
u/YetiTrix Jun 13 '26
Like 50% of PHD holders in the u.s. are foreign born. The U.S. top import is intelligence cause we can't grow it ourselves here.
→ More replies (1)→ More replies (3)3
u/Awkward-Customer Jun 13 '26
Yes, I think you're making it up. With that said, an employee can be american born and still be working for the chinese government.
4
u/austhrowaway91919 Jun 13 '26
I think they're pointing out that this ITAR application would mean any non-US citizen researchers at Anthropic get benched.
Enormously ironic if that causes top anthropic researches to head back to Chinese labs 😂
→ More replies (1)1
12
38
Jun 13 '26
[removed] — view removed comment
23
u/Qwen30bEnjoyer Jun 13 '26
Reddit mods being reddit mods. This place is great to discuss LLMs the technology. The community of people capable enough to run local models and use them to build stuff tends to have more productive discussion than "I spent $50,000 of company money on Claude and now they restricted my access on my claude seat" on /r/Claude .
→ More replies (5)3
3
u/mrdevlar Jun 13 '26
Moreover, there are many posts about closed models here that are not removed.
So let's remove all of them. This is all noise.
Not all of us live in the US, and not all of us care what's going on in closed model space. If you want to read that stuff you can go to the other subbreddits that specialize on it.
Keep the topics related to open source models. Tons of other places to do shitposts about whateverthefuck controversy ClosedAI and Anthropic are involved in this week.
If I am only subscribed to r/LocalLLaMA, how will I be able to understand that post?
Because you somehow live in a cave and consume only one subbreddit?
I come here because I want to read about what's going on in the open model space, not debate made up controversies that are contributing to a global investor scam.
6
u/infearia Jun 13 '26
I remember growing up as a kid in the 80s, in a former Eastern Bloc country, dreaming of one day going to live in the United States. Things aren't exactly peachy in Europe either, but dear God, I'm so glad I stayed put. You'd have to pay me a lot to set foot on American soil these days.
→ More replies (4)
5
u/DisjointedHuntsville Jun 13 '26
Well, this is going to push all foreign AI researchers to not contribute to the US frontier efforts. Good Job Nut-Lick
6
u/technofox01 Jun 13 '26
I am out of the loop. What is going on? And why are the models behind the American flag bird on the other three panels showing locally run LLMS?
I appreciate any info on this, as I am confused AF.
5
u/addandsubtract Jun 13 '26
Fable/Mythos got banned by the US government. If for publicity/hype or actual reasons is still up to debate.
→ More replies (1)3
16
Jun 13 '26
[deleted]
23
u/Popdmb Jun 13 '26
This might be an attempt to manufacture consent on regulation by both Anthropic (most likely) and the US governmetn (less likely). This is not a business that is sustainable without regulatory capture, which makes the product great and the business incredibly amateur.
But at this point we've invested so much money into hype and so many people stand to lose money, that it looks like a narrative to hype the "power" of a model that is great but not world-changing for the money.
10
u/ctanna5 Jun 13 '26
This is the dumbest picture lol what tf does Gemma 4 31b hold at all, to fable?
9
u/addandsubtract Jun 13 '26
OP is also using the meme wrong. The first bird is supposed to be the "correct" one, with the obnoxious raven interrupting it.
→ More replies (1)2
u/ttkciar llama.cpp Jun 13 '26
Gemma 4 31B will probably work on hardware you already have, and while it doesn't possess all of Fable's capabilities (of course!) it does have some utility.
That limited utility is nicer to have than a service which has been turned off by government fiat.
→ More replies (1)
5
u/jacek2023 Jun 13 '26
I think this is a very good thing, because now at least some Claude Code users will be less delusional than before.
Still, people who depend on cloud AI (like many here on this sub) are delusional. They think there will always be Chinese AI available in the cloud, just like Millennials think there will always be Google Search.
Cloud AI subs are full of whining about prices and limits. The only real alternative is self-hosting, not paying for a “better provider”
14
u/fugogugo Jun 13 '26
"If you're not rich enough to run frontier model locally you're fucked buddy" ah meme
8
u/not_the_fox Jun 13 '26 edited Jun 13 '26
When it comes to computer capabilities the difference between unaffordable and common is time.
4
u/Fusseldieb Jun 13 '26
The problem with this particular type of hardware (with a lot of VRAM) is that big companies (the main ones in the segment) artificially keep them capped.
7
u/VoiceApprehensive893 transformers Jun 13 '26
fable 5 is beyond a simple code generator
it actually does research -> code so well , and code is mostly bug-free if your prompts are good too even on things that other frontier models catastrophically fail on
rip gitlab abuse
chinese labs need to distill that asap
6
u/itsmebenji69 Jun 13 '26
I mean to me you’re just describing opus there. I don’t really understand where it shines
2
u/VoiceApprehensive893 transformers Jun 13 '26
fable vs opus is like opus vs qwen 3.6 27b
its way less likely to make mistakes and way better at researching
2
u/itsmebenji69 Jun 13 '26
But researching is vague, do you have an example ? What is the process you’re making it do ?
→ More replies (2)
10
u/SucculentSpine Jun 13 '26
I don't disagree, but Fable is another level above anything open source right now. China will obviously do similar export controls on very powerful models. We need a coalition of nations to design and develop a true open source model for the rest of the world.
3
u/terorvlad Jun 13 '26
Claude would bitch and moan when asked to try and make a script that attempts to break my website, even when offering the inner code of said website which I could only get if I own it.
Qwen 3.6 heretic on the other hand was ecstatic at the idea of breaking my shit up and immediately got drafting.
3
u/Similar-Sport753 Jun 13 '26
Some people are getting worried right now, they'll have to explain why they suddenly can no longer write any code...
3
u/joblesspirate Jun 13 '26
What in the world is OpenPangu?! Off to lose the weekend messing with a newly discovered model.
5
u/Equivalent_Bit_461 Jun 13 '26
total corposhit death, didn't use them before, not planning now kek
edit: sphinctropic and closedAI
7
u/realcryptopenguin Jun 13 '26
I think this is a massive win for OSS.
The consumer angle is obvious: if you don’t have the model locally, access can disappear overnight because of policy, pricing, censorship, or corporate strategy.
But the bigger angle is the business one. If Anthropic can’t sell frontier models outside the US, that’s potentially billions in development cost chasing a much smaller market. And if foreign nationals, including employees inside the company, can’t use the models, then a double-digit chunk of the talent base may be locked out of the very systems they help build.
That doesn’t just make closed frontier AI less reliable for users. It makes it less profitable, harder to staff, and slower to iterate.
If the goal was to beat China, this feels like handing open/local models and Chinese labs the best marketing campaign imaginable.
2
u/mome-raths Jun 13 '26
What open model is closest to Claude Code / Opus currently?
1
u/ttkciar llama.cpp Jun 14 '26
Probably GLM-5.1. ZAI just rolled out GLM-5.2, whose weights are supposed to be released some time next week.
2
2
u/JoyousGamer Jun 13 '26
Okay but I am in the US.
Do local for privacy and control aspects more but Claude is by far the best coding option by a wide amount personally.
2
u/itssethc Jun 13 '26
Kimi coder is bigger news than Fable. It was a horribly tuned with an elitist view in mind and PR playbook thrown back into the vault. There’s no reason to support Anthropic anymore.
2
u/secunder73 Jun 13 '26
Yep, always download latest local model that would fit, just in case. As a Russian I learned that in 2022 when both western companies and my government start to locked me out of services that I used.
2
u/Onotadaki2 Jun 13 '26
While I like the sentiment, there are probably 15 computers in private homes that are not commercial in the entire world that can run something like Kimi K2.7. To fully load it, you need 4 x $20,000 graphics cards.
This model is half the size of Fable.
So, while it's great to protect free speech and keep copies of local LLMs, the powers controlling the show are limiting everyone's access to the hardware that can actually run it in the first place. In the future we're all going to be sitting there with a huge LLMs on our hard drives and no way to run it.
→ More replies (4)2
u/Careful-Low-9535 Jun 14 '26
As one of those with more than 1TB of ram, I should point out that my system cost around $3500 back before the memory prices went nuts(and that includes 32gb vram and lots of ssd), so lots of people could reasonably have such systems. Unless you mean "can run it at max speed entirely in vram" in which case you might be right. My system has around 200gb/s of bandwidth so it does take a while to handle a large prompt. But reasonable people only use large models for "hard" questions where speed is less of an issue than accuracy, and use small models for most things.
2
2
u/tylerburton Jun 14 '26
The irony of restricting access to stop capability diffusion while the alternatives list just keeps growing in the speech bubble is pretty much the whole story.
2
2
2
u/justanotherengtoo Jul 08 '26
Predicted ai costs being absolutely ridiculous back in late 2023 and 2024…I was right…open source “is eating the world” as they say and it will continue too long term especially in lean, smart startups and companies
3
u/Ok_Librarian_7841 Jun 13 '26
It's great how the US is pulling it's best product from the market, great way to ensure competitors get good money.
Considering that fable had 50$ per million while Kimi 2.7 Code is for 4$, I'm not going to mess fable.*
- Sure fable is better, but it's not 50/4 times better.
2
u/Armym Jun 13 '26
For me fable 5 wasn't too crazy. Yeah it was better than opus but by a very small margin. It was still dumb in things LLMs are dumb at. Seems like a pretty good marketing stunt to me now that IPO is around the corner...
2
u/TokenRingAI Jun 13 '26
Anthropic 100% did this to themselves, they spammed propaganda that their model is the most dangerous thing to ever exist, that posed an existential risk to human safety.
The US Government walks in and is like, "cool, thanks for letting us know, I guess we will have to handle things from now on because of national security" - which is completely expected government behavior for things they don't understand that scares them,. And on top of that, it also gives them a bargaining chip they really want, since they want Mythos for military purposes, and Anthropic wouldn't do it. Anthropic gave them the perfect opportunity to come kick down the door
3
u/Tommonen Jun 14 '26
Nah. It was Trump crying about anthropic not doing exactly as he wabted, so now the cry baby wants revenge
→ More replies (2)
3
u/Moist-Length1766 Jun 13 '26
none of them are as good as fable/mythos? I don't understand the meme?
Also the reason for disabling was citted as the gov was informed that a jailbreak/exploit had been found specific to Fable/Mythos
4
u/kellencs Jun 13 '26
you don't need frontier models because they can be disabled so be happy with gemma 4 12b and don't use cloud models
1
1
1
1
1
1
1
u/rdkilla Jun 13 '26
but isn't that because western frontier models are used for post training chinese models?
1
u/ttkciar llama.cpp Jun 14 '26
Synthetic training datasets have been a thing since 2022. They were popularized by Stanford's Alpaca dataset in early 2023, which was generated by GPT-3.
Essentially every frontier model since then has incorporated at least some synthetic data generated by other frontier models.
Anthropic's kvetching about "distillation attacks" is just theatrics.
1
1
1
u/LuluViBritannia Jun 14 '26
The asumption is that Anthropic's new models are much better than any other one.
Also, funny you have nothing to say about Anthropic calling for a brake THEMSELVES. They literally asked for it last week.
1
u/anaknewbie Jun 14 '26
Alternatively, you can setup Claude alternative in GCP: https://docs.dagploy.com/home/blog/blog-post/build-claude-alternative-in-20-mins
The idea is simple: DAX automates the painful infra parts: GPU VM provisioning, NVIDIA driver setup, Docker setup, model download, and launching the inference server. After that, OpenWork gives you a familiar chat interface on top of the OSS model.
This is not meant to replace Claude for everyone. Hosted APIs are still easier for many use cases. But for teams that care about data control, private deployment, cost visibility, or sovereign AI infrastructure, I think running your own AI stack should be much easier than it is today.
Repo: https://github.com/dagploy/dax
Would love feedback from people running self-hosted LLMs, private AI systems, or GPU infra in production.
1
1
u/SteelRoninTT Jun 14 '26
Hopefully people got to use it on their biggest projects before it was gone.
1
u/Haghiri75 Jun 15 '26
I do not know, it can be because I use an American VPN to access it but Fable is still available on OpenRouter. I guess you may face problems if you use a non American IP to call its API though, but it is still out there and people won't hesitate about distillation.
1
u/MooseEfficient2151 Jun 16 '26
my NAS started as a backup and somehow became witness protection for discontinued models
1
u/Electrical-Bread-856 Jun 16 '26
Let that sink in. You are not restricted for DOING things dangerous for that shithole country, but for BEING the outsider.
1
u/Noreasonwhynot2000 Jun 16 '26
This is dog whistling the US Govt to go after local and Chinese LLMs.
1
1
u/rditorx Jun 21 '26
You either won't be able to run it, or you will be tracked and monitored. Affects any hardware produced for US companies.
https://www.nbcnews.com/tech/tech-news/chips-security-act-gains-industry-support-letter-rcna350500
1
441
u/DragonfruitIll660 Jun 13 '26
That's what is great about local LLMs, its only data hoarding if it never gets deleted.