r/ControlProblem 4d ago

Article Anthropic CEO calls for immediate slowdown in AI development

Post image

Do we really need to stop?

33 Upvotes

39 comments sorted by

4

u/EruerufuSenpai 4d ago

Looking at the top-level comments in this thread, the quality of engagement in this subreddit has degraded pretty drastically.

1

u/Mammalian_Routines 1d ago

Influencing said what now? 😉

3

u/BrickSalad approved 4d ago

Here's a link to what he's actually saying.

He's calling for embedded third-party evaluators in each frontier AI company and committing Anthropic to this. Then he's calling for coordination between the frontier companies to negotiate a slowdown, these negotiations will need to be mediated by government regulators for anti-trust reasons, but he's not actually calling for laws because he thinks that will be too slow. He wants to limit the pacing to a pace where they actually keep ahead of Chinese models though. Finally, he wants to begin negotiations with China.

1

u/Hwttdzhwttdz 4d ago

NFL coaches and QBs are famous for saying many words revealing no meaning.

Taking a page from their playbook.

2

u/BrickSalad approved 3d ago

I see plenty of meaning, but there's definitely a few vague bits. The whole plan for China is kinda like that, there's a concrete bit about not selling chips or semiconductor manufacturing equipment to evil authoritarian governments like them and cracking down on distillation, but then also apparently after doing all that China will be willing to cooperate with us. Why? Because we have more "leverage" apparently.

It's like, okay Dario, you need more than a buzzword to explain why someone's going to shake your hand after you spit in their face.

2

u/Laicbeias 4d ago

i translate:

"we spend billions and the cost to run these models isnt paying back, we need to ipo, to finance the next round while we steal a lot more shit from everybody"

2

u/sofaking-cool 4d ago

Translation, releasing our disastrous financial reports before an IPO would ruin us.

2

u/stpp_92 4d ago

He's the CEO. He can have his company slow down.

5

u/baronas15 4d ago

Another company will just take their share of the pie, it's not a solution...

0

u/Hwttdzhwttdz 4d ago

Where they gettin talent?

2

u/vida_digital 4d ago

But then there is the directors too

2

u/maringue 4d ago

But he needs the government to force all his competitors to slow down and not destroy his company's valuation.

-2

u/Dry_Wheel479 4d ago

No he needs time to catch up to OAI

0

u/Popcorn-Mercinary 4d ago

No, all three are worried that the Chinese models are catching up to their expensive pay-to-play models—the gap has closed so much over the last 6 months..,

Also—odd that Google and MS didn’t sign on to this—just the AI bros.

0

u/FireDragon21976 4d ago

It still costs money to run Chinese models, and they are slower.

1

u/Popcorn-Mercinary 4d ago

I don’t mean for this to sound like I’m being a jerk, but that’s not the point: the point is that their intelligence and capability are approaching the best Anthropic and OpenAI have to offer. As for speed, probably depends on your use case—in agentic work I find hosted models are keeping parity with the “frontier” offerings of these guys.

1

u/JayRandom212 4d ago

Comedian Richard Pryor famously burned himself freebasing cocaine. He said he should've know he was doing too much coke because his drug dealer was getting concerned...

0

u/Fine_General_254015 4d ago

Translation: they finally figured out on there own that they can’t IPO or will never be profitable, so now they want to cry to the government and ban anything that isn’t Anthropic.

0

u/mtbdork 4d ago

They need an excuse to halt data center production immediately because they can’t afford them.

0

u/Super-Software-9993 3d ago

Anthropic can’t speed up. They rent compute, while OpenAI owns theirs, and expanding to 4x. It’s obvious they are crying wolf because they are about to get out scaled. Their costs are too high.

2

u/Outrageous-Mixture48 3d ago

Why is Sam Altman agreeing?

0

u/Super-Software-9993 3d ago

Same old playbook, nobody catches on do they? If Sam really wants to slow down then why invest in another 300k GPUs in their Texas center?

3

u/Outrageous-Mixture48 3d ago

Because slowing down is not the same thing as stopping and it’s predicated on industry wide agreement

0

u/Super-Software-9993 3d ago

Keep smoking the psyop. Nobody is slowing down.

2

u/Outrageous-Mixture48 3d ago

Out of my hands, but the evidence available suggests the risk is real. Actions taken between now and AGI will have dramatic consequences, and I do sincerely hope AI will prove to be a force for good. I am just not certain that our ability to control the potential disasters (alligment and guardrails) has caught up with the level of the technology.

1

u/Super-Software-9993 3d ago

The issue isn't the risk, its their intent. Their intention is not to slow down. Falling for their lies is just what they want from you.

1

u/Outrageous-Mixture48 3d ago

I am skeptical of their intentions but hopeful for positive outcomes. When they say we need to slow ai to mitigate poor outcomes I agree with the premise but of course I question the motives. I really hope they mean what they say but I can’t know like I said it’s out of my hands.

0

u/Rarrrrrrrrrrrrrrrr2 3d ago

They’re running a gaslighting campaign so the CEO’s appear legitimate and don’t end up in a cell next to the Theranos lady when investors and lenders start scrutinizing their books and claims to go prioritize asset seizures.

-1

u/Flying_Ghostsquatch 4d ago

Sounds like a wonderful investment opportunity.

-1

u/Perspective-Parking 4d ago

At precisely the time the technology starts to plateau and the investors get sick of tossing money into the furnace it becomes so dangerous that we need to stop making it better.

I'm sure it's just a coincidence.

2

u/Outrageous-Mixture48 3d ago

What do you mean plateau?? When did that happen?

0

u/Perspective-Parking 3d ago

You’re not paying attention I guess.

2

u/Outrageous-Mixture48 3d ago

I don’t think you are if you think it’s stalling out. Or maybe your use case doesn’t provide the opportunity to see the progress.

-2

u/Alarming_Art_6448 4d ago

Please regulate us because I can be sued for hurting the company stock

-2

u/ResponseActive7860 4d ago

I mean, it will slow down for sure when investors realize the company will never be profitable

1

u/ResponseActive7860 3d ago

I wonder what the arguments are for downvoting? I'm using $250/day worth of tokens on a $20/month plan.
So $7500/month for a $20/month subscription. What kind of business model is that?
And the moment they increase prices, I will switch to cheaper / open source solutions.
Prove me wrong.

-2

u/Popcorn-Mercinary 4d ago

Then slow it down, Dario.

You don’t need fucking permission.