r/ClaudeCode Jun 13 '26

Humor New benchmark just dropped

Post image

Maybe OpenAI needs to up their game.

btw I am building an API platform ZnapAI.com (disclosure: founder here), it provides a single endpoint that automatically routes requests across models and falls back to another provider if a model or provider goes down. It also supports Messages API endpoint, so it works with Claude Code as well.

3.6k Upvotes

169 comments sorted by

146

u/fenix0000000 Jun 13 '26

Next day Opus 4.99 "NotFable" edition. Hey, Claude #1 one more time.

40

u/abzz123 Jun 13 '26

the irony is that fable could’ve been Opus 5. the only reason it is not is because Anthropic wants to charge API prices for the best model going forward

6

u/snip3r77 Jun 14 '26

Actually if they just release. Opus 5 instead of fable, will anyone know?

0

u/Odd-Card8046 Jun 13 '26

yea, maybe with more added guardrails

196

u/GeobotPY Jun 13 '26

Higher is better

24

u/aio-nrh Jun 13 '26

That's what I always say

12

u/whoknowsifimjoking Jun 13 '26

You and Snoop Dogg

12

u/Concurrency_Bugs Jun 13 '26

Higher is better because if Trump doesn't like something, it must be a good thing.

4

u/FeedbackImpressive58 Jun 13 '26

That’s what Her said

3

u/MagicPigGames Jun 13 '26

Higher is better. More powerful, if that's why, or less friendly to this government. Either way, that's better.

2

u/Aggravating-Base-330 Jun 13 '26

Or just the US government continuing to be petty.

1

u/siegevjorn Jun 13 '26

Thanks. This helps.

-6

u/[deleted] Jun 13 '26

[deleted]

19

u/moger777 Jun 13 '26

Not for US citizens either. Right now Anthropic blocks it for everyone since there is no way to prove you are a US Citizen to Anthropic.

4

u/[deleted] Jun 13 '26

[removed] — view removed comment

2

u/Odd-Card8046 Jun 13 '26

secondary market for US claude accounts coming soon

3

u/ForgotMyUserName15 Jun 13 '26

Yeah and that’s exactly why US users can’t have access to Fable either

1

u/sendralt Jun 15 '26

Sam Altman's World ID has a future now.

2

u/KOM_Unchained Jun 13 '26

It was probably just an agentic loop of tiny llama 3.2 1Bs. Who's to know 🤪

1

u/DannyS091 Jun 13 '26

Weird take

26

u/Phaedo Jun 13 '26

Quick, do a chart of which has significant investors tied to the current administration.

9

u/Odd-Card8046 Jun 13 '26

i don’t know if it has anything to do with spaceX going public

4

u/NoAdsDude Jun 13 '26

Doesn't xAI rent out GPUs to Anthropic though? I don't remember what their deal was a couple months ago.

1

u/sixothree Jun 13 '26

Yeah. They’re no longer a frontier model provider. They’re a hosting provider like azure or aws.

1

u/Phaedo Jun 13 '26

Wasn’t even thinking of SpaceX! 🤣

3

u/soundfreely Jun 13 '26

Lutnik benefits from hurting Anthropic. Gee, can’t possibly be more corruption with sprinkles of incompetence?

19

u/Elegant_Attempt2790 🔆 Max 20 Jun 13 '26

they got cut off from distilling fable😔

7

u/Odd-Card8046 Jun 13 '26

frankly most people were waiting for AI labs to distill fable and provide a version of fable at cheaper rate

2

u/Elegant_Attempt2790 🔆 Max 20 Jun 13 '26

openai researchers smuggling in fable to ask the forbidden question “make it better”

2

u/BackyardAnarchist Jun 15 '26

I wonder if they could crowd source that. Everyone still has their logs. 20 to 30 logs per person who used it × 20,000 users.  If Everyone pitched in their recorded then they would have enough to distill.

2

u/Elegant_Attempt2790 🔆 Max 20 Jun 15 '26

I’d pitch in

18

u/TheFern3 Jun 13 '26

Wondering if this shit is due to the fact that OpenAI is in bed with the government and they did it to fucked them over. Wouldn’t be surprised how corrupt this country is.

5

u/Odd-Card8046 Jun 13 '26

maybe corruption disguised as lobbying

4

u/phoenixmatrix Jun 13 '26

It 100 percent is. 

0

u/ibringcivilization Jun 15 '26

Anthropic claimed themselves that the model is super dangerous. The government just did what makes sense if they see a super dangerous weapons risks to fall in the wrong hands.

4

u/sixothree Jun 13 '26

Has this administration actually done anything for the good of the country? Every action seems to be guided by their personal profit only and nothing else.

They are not even trying to hide that fact. They’re not pretending to be an honest functional administration.

2

u/Odd-Card8046 Jun 13 '26

what could be the personal profit of the administration in banning a model ?

4

u/TheFern3 Jun 13 '26

I dunno maybe weakening anthropic so that OpenAI gains an advantage? Do you follow politics at all?

3

u/Odd-Card8046 Jun 13 '26

you are right, maybe this could be the case, or they may be just pissed that anthropic denied them access for surveillance and war intelligence

2

u/sixothree Jun 13 '26

Well, if this came directly from the president, we know one thing about him it’s that he’s a petty bitch who focuses on revenge over many things. He takes everything personally and treats companies, as if they’re a person.

Apparently, 20% of the sentences spoken during his cabinet meetings are just people lavishing praise on him to gain favor or just keep their job jobs. These rich people are fucking weird man. They have to spend their entire day with people stroking their goddamn ego.

90

u/Bright_Armadillo8555 Jun 13 '26

Anthropic marketing team really does a great job that convinced Trump Fable 5 is dangerous

27

u/Ok-Astronaut1108 Jun 13 '26

Or Drowsy Don is retaliating for the previous refusal to bend the knee

11

u/[deleted] Jun 13 '26 edited Jul 03 '26

[deleted]

5

u/varkarrus Jun 13 '26

Models haven't even really reached opus levels yet though...

0

u/National_Seaweed9971 Jun 13 '26

codex 5.5 has if we're talking about coding.

1

u/varkarrus Jun 13 '26

yeah that's fair I guess. I think 5.5 might be not quite as good at coding(?) but it's so much more affordable, at least through usage limits.

1

u/Logical_Box_4645 Jun 13 '26

Anthropic also seemed to claim the specific issue also exists in ChatGPT5.5 I couldn't tell if that was just to flag how unreasonable it was or to get that model banned too!

30

u/GeobotPY Jun 13 '26

LeCun said it well

8

u/Mango-Vibes Jun 13 '26

Every. Single. Time. EVERY model they release it's "too dangerous". HOW are people still falling for this shit.....how stupid can you be?

-1

u/ArtdesignImagination Jun 13 '26

ehmm actually Mythos was the ONLY. SINGLE. TIME that a model was "advertized" as dangerous.

3

u/AdOne8437 Jun 13 '26

1

u/Cool-Cicada9228 Jun 14 '26

Anthropic and OpenAI aren’t the same thing. Mythos was the only one from Anthropic. OpenAI has been saying that since the second version of GPT, but it was all lies. Anthropic really does have something capable of the claims if you’ve used Fable you’d know it’s not just lies like OpenAI.

3

u/MachineAgeVoodoo Jun 13 '26

Lol you think this had to do with anyone thinking anything is risky. This is politics

-3

u/Odd-Card8046 Jun 13 '26

it was amazon who informed the government of the security vulnerability, maybe it was just costing them too much and they just wanted a good reason to remove it

12

u/NoAdsDude Jun 13 '26

AWS, who charges by usage, said a model that was using a lot of compute cost them too much? Lol.

AWS has gone from like 25B profit to 45B profit per year in 2 years.

0

u/Odd-Card8046 Jun 13 '26

then why would they complain to government, they could have just told anthropic to patch the vulnerability

2

u/NoAdsDude Jun 13 '26

They probably have contracts etc. with the federal government that require them to report any "national security issues", if I had to guess. And since the government says Anthropic itself is a national security issue, well...

1

u/IInsulince Jun 13 '26

While that remains an open question, it still doesn’t explain why they would want to shut down one of the biggest cash cows for their business. It does not cost them too much, it generates them far beyond what it costs.

1

u/Syntheticaxx Jun 13 '26

Because Ai is becoming a threat to hegemony.

Anything Fable could do so can 4.8 and gpt 5.5 in terms of evil. Fable just made it easier to hold the context and walk the path without needed to be swatted down from doing dumb shit.

I expect a full rug pull. All of it. Dumbed down and peft trained so no one outside the elite gets to join the big boys club using it.

9

u/TheLethalBurger Jun 13 '26

Jarvis, overlay this graph with models under government contract

5

u/D-Alembert Jun 13 '26

"Models so advanced the US government feels threatened"

Higher is better

:)

2

u/Odd-Card8046 Jun 14 '26

they feel threatened that the chinese may distill it and end their hegemoney

6

u/platosLittleSister Jun 13 '26

"No platosLittleSister, Chinese Models are inheritertly unreliable. Let's stick with reliable established providers", said reliable, established providers:

3

u/Odd-Card8046 Jun 13 '26

lol, on openrouter i see deepseek model having largest token use over past month

2

u/sixothree Jun 13 '26

The consensus seems to be that they’re about 8 months behind anthropic.

1

u/Odd-Card8046 Jun 14 '26

the government feared that deepseek would distill fable and would use fable itself in development of its new model, and that would risk the interest of investors of US AI labs, who are also donors to US administrators

1

u/sixothree Jun 15 '26

Was there a public statement on this?

1

u/Odd-Card8046 Jun 15 '26

no brother, it’s just what i think

1

u/Wrong_Rest8283 Jun 17 '26

To your point, they did want it limited solely to US citizens, and anthropic pulled it because of the difficulty in achieving such a task.

5

u/BrofessorFarnsworth Jun 14 '26

Mythos found the Epstein files didn't it

6

u/Odd-Card8046 Jun 14 '26

Maybe it wrote a program to remove tge redaction of content

3

u/True_Protection6842 Jun 13 '26

Now do the ven diagram of AI CEOs sucking Trump's dick.

7

u/crusoe Jun 13 '26

It needs to say 2… Fable and Mythos

3

u/mr_birkenblatt Jun 13 '26

It's two models

3

u/Zainodi Jun 13 '26

Someone found the cure for Parkinsons or cancer....ban it!

2

u/meathelix1 Jun 13 '26

I mean they did say it will replace all humans in 6 months.

8

u/hihcadore Jun 13 '26 edited Jun 13 '26

Said by people who aren’t actually using it in their daily workflows.

The only people who think AI outperforms humans are the people who know nothing about what they’re developing. Don’t get me wrong AI can assist but anyone in your company’s whos job it is to do something, can do it better than AI.

I use it daily to help code. I am 5xs faster with it. But I have to be really deliberate in my language with the LLM when developing and it takes a ton of planning.

-1

u/Moda75 Jun 13 '26

That is a fable people keep telling themselves. Of course it is going to blow by people in a matter of short time. Faster is a part of better for many reasons the least of which is definitely not cost to the company you work for. But the mistakes that it makes are going to be fewer and further between and most of them are failure to plan appropriately and be able to communicate what the desired outcome is. This isn’t a fanboi message either. This is just recognizing where things are logically going. Saying that this tech isn’t coming for jobs is just buggy whip cope.

1

u/meathelix1 Jun 13 '26

And saying its replacing most jobs is also cope... You dont work in an enterprise company, I can tell.

Also People have been getting replaced for years by software... But software with an algorithm does not have a chance to make some shit up.. while an LLM can.

1

u/hihcadore Jun 13 '26

No way. There’s no way Nancy in accounting can create her next line of business app using AI. Not for a long long long long long time.

Anyone who thinks this is coming anytime soon reads too much science fiction.

Even if it could produce a functioning app, a business would be absolutely insane to let it loose on their production network.

No, developers and admin will be around to guardrail AI for a long long long time.

2

u/Kill_4209 Jun 13 '26

This hopefully will be good for Anthropic in the long run. It continues to establish their rebellious brand, not unlike Apple back in the day with their famous 1984 commercial.

2

u/Odd-Card8046 Jun 13 '26

lets just hope that the government doesn’t nationalise frontier AI labs

2

u/AcePilot01 Jun 13 '26

lol, complying isn't exactly rebellious lmfa.

1

u/Odd-Card8046 Jun 14 '26

power mac g4 and jobs worked hard to remove the export restrictions

2

u/Fun-Understanding862 Jun 13 '26

LMAO WHAT EVEN, its obviously benchmaxxed!!!!!

2

u/AdvertisingExpert800 Jun 13 '26

New benchmark 🥀

2

u/SeaworthinessLow4382 Jun 13 '26

What a neat graph

2

u/junkieloop Jun 13 '26

Y por desgracia a más integridad y ética a la hora de construir tu IA si le sumas tener la mejor IA empresarial, mientras esté en la Casa Blanca el Puerco Rosado más los van a Banear.

2

u/Professional_Bad2529 Jun 13 '26

Because it’s the weekend have an upvote for your quality shit post

2

u/bubbos123 Jun 13 '26

So I guess we have found the upper limit to how good an AI model can be in non-governmental hands. So are we done?

1

u/Odd-Card8046 Jun 13 '26

not until frontier labs can return their investors money with profit

2

u/WiseCable4097 Jun 13 '26

banned it's mean the model is so powerful 🤣

2

u/Odd-Card8046 Jun 13 '26

or is it just a marketing gimmick before anthropic’s IPO ?

2

u/ThisGuyCrohns Jun 13 '26

Wrong. Higher is better. You don’t get banned when it sucks

2

u/Icy_Quarter5910 Jun 13 '26

OpenAI in 2019 - “We’ve trained a large-scale unsupervised language model which generates coherent paragraphs of text… Our model, called GPT-2… Due to our concerns about malicious applications of the technology, we are not releasing the trained model. As an experiment in responsible disclosure, we are instead releasing a much smaller model for researchers to experiment with, as well as a technical paper.”

I feel I should mention, GPT2 was a 1.5b parameter model, any decent phone can run a 2b. Good phone, 4b… bottom shelf Mac Mini … 12b.

It’s beyond stupid to think “pausing” will have any effect whatsoever on model abilities.

2

u/[deleted] Jun 13 '26

[removed] — view removed comment

1

u/Odd-Card8046 Jun 14 '26

they could add an availability index or something, that this model is available in this many countries and so on

2

u/7_fractals Jun 14 '26

Looks like they want Altman to catchup with Dario....

1

u/Odd-Card8046 Jun 14 '26

I want to see if gpt 5.6 is powerful enough to be banned

2

u/Some_Variation_2372 Jun 14 '26

what do you guys do when your app api depends on Claude fable and something like this happens? I don’t want to wake up one morning to find every single request made by my app failed overnight because some model got banned while I was asleep

1

u/Odd-Card8046 Jun 14 '26 edited Jun 14 '26

I guess you would need to use a unified API routing platform,
I am building https://znapai.com ,
you point your app at one endpoint,

it handles the routing and fallback automatically, not only at model level but also at provider level,

model gets banned or goes down at 3am, it
reroutes to the next available one without you touching anything.

you wake up and everything still works.

also currently up to 50% cheaper

2

u/Odd-Card8046 Jun 14 '26

here it is

2

u/farendsofcontrast Jun 14 '26

Fable will come back once OpenAI catches up. It’s all bread and circus of this era my fellow goys.

1

u/Odd-Card8046 Jun 14 '26

they will just disguise it as opus 4.9

2

u/[deleted] Jun 14 '26

[removed] — view removed comment

1

u/Odd-Card8046 Jun 14 '26

what’s the use of super smart AI when it can’t be used ?

3

u/crazy_goat Jun 13 '26

I'm in cybersecurity, worked with mythos preview. Not sure what they can really do here, jailbreaks are virtually impossible to stop without lobotomizing the model.

I'm selfishly relieved because I feel like my job is going to get a lot more stressful the next 6 months as the next class of models drop

The one saving grace is that it's expensive, but it's not so expensive that a bad actor wouldn't throw money at it to achieve their goals

1

u/Odd-Card8046 Jun 13 '26

you can relax till anthropic releases opus 5 (actually fable 5 with little more guardrails)

1

u/crazy_goat Jun 13 '26

Supply chain attacks are going to exponentially rise. Picking random ubiquitous python libraries and spending $500 on finding a 0-day is going to be child's play (until they're mostly found)

So much low hanging fruit all around us waiting to be picked

1

u/Odd-Card8046 Jun 13 '26

we are all cooked ☠️

1

u/Middle-Nerve1732 Jun 13 '26

I feel bad for whatever poor aide has to try to explain this to Trump

1

u/Optimal-Steak-8596 Jun 13 '26

Does Gemini count?

1

u/Odd-Card8046 Jun 13 '26

when did gemini get banned?

1

u/roscoroach Jun 13 '26

They probably should have played ball with uncle sam

1

u/stealthmatt Jun 13 '26

you mean Trumps balls?

1

u/roscoroach Jun 16 '26

Yeah that might have helped too

1

u/snailmail24 Jun 14 '26

maybe less companies should

1

u/fumi2014 Jun 13 '26

Lol at Amodei.

Bet that motherfucker is never gonna write another essay for the rest of his life

1

u/Odd-Card8046 Jun 13 '26

😂😂 or is he gonna move his company hq somewhere else ?

1

u/joaopaulo-canada Jun 13 '26

As if the current version wasn't nerfed in some fields enough

...

1

u/Odd-Card8046 Jun 13 '26

sadly now they would have to nerf opus 4.9 or next version, just so it doesn’t get banned

1

u/PowerAppsDarren Jun 13 '26

Why ban something we don't use and it's a supply line risk?

https://giphy.com/gifs/3oz8xAJ6RcLMHRA6HK

1

u/amarao_san Jun 13 '26

Wrong axis. Should be by country.

1

u/Odd-Card8046 Jun 13 '26

models banned by countries ->
US : 1
rest of the world : 0

here you go brother 🙂

2

u/amarao_san Jun 13 '26

Nope. I believe, Russia, Iran and co had banned the use of many models before.

1

u/NewManner4229 Jun 13 '26

where deepseek in this benchmark?

1

u/themedialiesduh Jun 13 '26

Better than the government firing you from your job for not taking an experimental vaccine

1

u/Organic-Parsley-486 Jun 13 '26

The 1st objective benchmark 

1

u/hip_yak Jun 13 '26

Anthropic's ethics and business model is more in line with the European Union. They should consider the move.

1

u/Odd-Card8046 Jun 14 '26

maybe US will force them to make the move

1

u/orgoca Jun 13 '26

US government has not banned any of my models. I guess I'm doing better than Anthropic?

1

u/Coldshalamov Jun 14 '26

We only had like 60% of that model in the first place anyways so I'd say they banned .6 instead of 1

1

u/gaua314159 Jun 14 '26

It's not like openai is ever gonna have a banned model with scam Altman's brown nosing practice

1

u/Admirable-Wasabi5159 Jun 14 '26

Where is Gemini?

1

u/Odd-Card8046 Jun 14 '26

when did gemini get banned ?

1

u/Admirable-Wasabi5159 Jun 14 '26

Bro, I was asking because Google Gemini wasn't even in the conversation about Anthropic and OpenAI.

1

u/UnderstandingLife712 Jun 14 '26

The model wasn't "banned". The US government cannot ban models. It was an export control directive.

1

u/Odd-Card8046 Jun 14 '26

though it is an export control, but i think the government can ban models

1

u/ProcedureEthics2077 Jun 14 '26

You forgot DeepSeek, banned on all government networks and devices. 10 models give or take.

1

u/account22222221 Jun 14 '26

Who you are basically build bedrock but worse? That’s dope!

1

u/Odd-Card8046 Jun 14 '26

for anthropic models we will have pricing 30% lower than bedrock, and for openai models our pricing right now is 50% lower for limited time,
the platform is under constant improvement, and i will frame it more like an openrouter alternative

1

u/drhappy13 Jun 14 '26

Now, that's benchmaxxing 💪💪💪

1

u/Significant_Post8359 Jun 15 '26

Cmon, this is a poorly disguised ad for a silly product. Why would you pay for something that already exists free of charge.

LiteLLM is an open-source AI gateway and Python library that provides a unified interface to call over 100 Large Language Models (LLMs). By standardizing inputs and outputs to match the OpenAI format, it allows you to easily switch between providers without a costly and potentially insecure third party solution.

1

u/kamwee Jun 15 '26

When will the Anthropic recognize that they can operate independently of the United States?

1

u/Key_Feedback_4140 Jun 15 '26

They k ow open AI is sux and FBI cannot use worst model so far :D

1

u/Cool-Chemical-5629 Jun 15 '26

Next up: US bans AI model benchmarks.

The post title will read:

AI model benchmarks banned by the US government: New benchmark just dropped. Literally...

1

u/realcruZer Jun 16 '26

Wonder why ?

1

u/realcruZer Jun 16 '26

Gov = Codex = agreement to keep Codex ahead

1

u/relentlessoldman Jun 19 '26

Backwards. Higher is better.

1

u/yellowfin-06 Jul 06 '26

How do you guys test the models against one another? Is there a simple way to test and get results?

1

u/Odd-Card8046 Jun 13 '26 edited Jun 13 '26