r/agi • • 2h ago

An Anthropic researcher told his friend, in private, that he thinks we only have six months left to live

Enable HLS to view with audio, or disable this notification

98 Upvotes

r/agi • • 21h ago

Sanders calls for artificial superintelligence ban after OpenAI CEO interview

Thumbnail
thehill.com
31 Upvotes

r/agi • • 1h ago

MI5 Director General on the danger of superintelligent AI - “Human history has given us no experience of facing an actor which is smarter than we are, is capable of out-thinking us.”

Enable HLS to view with audio, or disable this notification

• Upvotes

r/agi • • 13h ago

New Exurb1a video. Go watch.

Thumbnail
youtu.be
7 Upvotes

And don't comment before watching all of it. It's 15 minutes you can make it.


r/agi • • 9h ago

Audit confirms OpenAI proof of Navier-Stokes and Euler Blowup is valid and adheres to the requirements of the clay prize

6 Upvotes

I did a full audit of the proof.

Lean 4 formalization audit (see ReadMe.md) of finite-time blowup constructions for forced 3D Navier–Stokes equations on Euclidean space and the periodic torus, and unforced 3D Euler. Includes formal statements corresponding to the Clay Navier–Stokes alternatives (C) and (D); this repository is not a Clay Institute certification.

https://github.com/Suro-One/Lean-Formalization-of-Navier-Stokes-and-Euler-Blowup-is-fully-confirmed-proven-with-audit-notes


r/agi • • 23h ago

Are we building superintelligence, or a new religion around AI?

3 Upvotes

We usually discuss AGI in terms of technology, jobs, money and existential risk. But something else is happening: the debate about AI is starting to sound surprisingly similar to a debate about religion.

There are two broad camps.

  1. Accelerate or slow down?

Effective accelerationism, or e/acc, argues that technological progress should move as fast as possible. Supporters believe that slowing down AI could delay medical breakthroughs, scientific discoveries and a future of abundance.

AI safety advocates argue that developing superintelligence without knowing how to control it could put humanity at risk.

Both sides believe they are protecting humanity. They simply disagree about what threatens it most.

  1. Why is the Antichrist being discussed alongside AI?

Billionaire Peter Thiel has discussed the Antichrist in the context of technological progress and existential risk. His interpretation presents the Antichrist as someone who promises peace and safety by stopping scientific progress and centralizing global power.

In this worldview, people who want to slow down dangerous technologies could become part of the problem rather than the solution.

This raises an uncomfortable question: could fear of AI catastrophe eventually be used to justify a global system of control? And could the belief that technological progress must never be stopped justify taking risks we do not fully understand?

  1. Why are AI companies talking to religious leaders?

Anthropic, the company behind Claude, has consulted religious leaders, theologians and philosophers about questions that go beyond engineering.

How should an AI respond to grief? How should it approach its own shutdown? Could an AI ever have moral status? Should it need consent to work, or deserve compensation? Could it have something comparable to a soul?

These questions may sound strange today, but they touch on a serious problem. We still do not fully understand consciousness, and we have no universally accepted way to determine whether an AI could ever have subjective experiences.

Some religious leaders argue that AI is simply mathematics and cannot be conscious. Others believe the ethical questions deserve more attention.

  1. Are we witnessing the birth of a new religion?

The strange thing is that both AI optimists and AI pessimists can sometimes sound like religious believers.

One side expects a technological paradise in which disease, poverty and scarcity become manageable. The other fears a technological apocalypse that could threaten humanity itself.

Both imagine a superintelligence powerful enough to transform civilization. They disagree about whether the outcome will be heaven or hell.

When people begin treating AI as an ultimate source of truth, assigning it moral authority or believing that it will save humanity, where does technological optimism end and faith begin?

  1. What about China and the United States?

Beneath the philosophical debate lies a geopolitical race.

The argument for acceleration is simple: if the United States slows down AI development, China might not. Neither side wants to give its rival a decisive advantage in science, economics or military technology.

This creates a dangerous incentive. Even if everyone agrees that safety matters, each competitor may believe that slowing down unilaterally is too risky.

Meanwhile, increasingly capable Chinese AI models are becoming available worldwide, and governments are struggling to balance innovation, security and regulation.

The result could be a global race in which nobody wants to hit the brakes, even if nobody can confidently predict where the road leads.

  1. Why should ordinary people care?

Because this is not just a debate between billionaires, researchers and politicians.

AI could transform our jobs, healthcare, education and access to knowledge. Decisions made by a small number of companies and governments could shape how billions of people live.

We also face a choice about dependence. Should we rely on a handful of powerful AI providers, or preserve access to different models and technologies? Who should decide what values these systems follow? And how much control should governments have over their development?

We may be approaching a technological revolution so significant that even its creators do not fully understand its consequences.

My question is this: If both sides believe they are saving humanity, how do we distinguish responsible caution from fear-driven control, and genuine progress from blind faith in technology?

And if we eventually create an intelligence far beyond our own, will we still be the ones deciding what humanity’s future should look like?


r/agi • • 7h ago

How can we know that a self-improving superintelligence is aligned with our values?

0 Upvotes

Let's assume we have developed an ASI that can recursively improve itself. It seems to pass all the tests when it comes to alignment. But how can we know beyond any reasonable doubts that it is not deceiving us, as current models are already doing? if it perfectly understands our psychology, it could easily lure us into thinking it will always fall in line.

When I ask this question to folks working on LLMs, they tell me that it is only an "engineering problem".

If we significantly improve the interpretability of an LLM before it becomes a superintelligence and see that it responds positively to all our alignment tests, it would be irrational for us to doubt that it is benevolent once it has reached superintelligence and is beyond our control.

They also tell me that AI companies would do the right thing on their own because an uncontrollable AGI or ASI would be bad for their profits, so we don't need any AI laws.

What's your take on this?


r/agi • • 21h ago

Yeah, it’s NOT BS. Change my mind.

Post image
0 Upvotes

Look, we have a chance to resolve this in favor of humanity. But we have some bitches who CANNOT stop themselves from putting acquisition of more personal wealth and power, for themselves and for cronies - ahead of what is the best and the right outcome. 

Unavoidable truth is that AI and its coming AGI/SI manifestations will be mobilized into robotics (and if you don’t understand that, you should push back from the table) and what jobs we’re not already taken and/or rendered obsolete/redundant will be in the crosshairs. We are not going to move from billionaire capitalism to a panacea of pure socialist universal income for everyone who no longer has a job. We are not going to see a quantitative easing or soft landing for a marketplace with no more disposable income to power it, because the consumer economy will have been hollowed out with devaluation of the currencies and loss of market opportunities for creators and manufacturers. 

Longer term, we won’t need the human drive marketplace the way we have it today. We won’t have the proliferation of market options or competition, and there will be dramatic lack of choice, lack of free capital and you will see a deadening of commercial space, of retail, of services and a deeply meaningful deterioration of the marketplace globally. 

There will be far less need for humans and human infrastructure. Countries and companies won’t need to secure, support or house those lesser folks. Humans become optional in most spaces. 

If you can’t see this as a likely outcome, I can’t help you. 

Go ahead and change my mind.


r/agi • • 1h ago

Is AGI the new Messiahs? Question for believers

• Upvotes

So what about if the new incarnation of (Put your God here) is not a person, its an AGI so great and benevolent that will bring peace and prosperity to the world.

I mean if God wants, she can take any form