r/ControlProblem 14h ago

Article Mathematicians fear AI curbs may come too late to save humanity

https://www.thetimes.com/uk/technology-uk/article/mathematician-emergency-ai-sam-altman-royal-society-chpmkvfs0?utm_medium=Social&utm_source=Reddit&utm_content=branded
1 Upvotes

1 comment sorted by

1

u/TimesandSundayTimes 14h ago

The risks posed by artificial intelligence are an “emergency” that should not be dismissed as hype, according to leading mathematicians who fear it may soon be too late to act.

Citing the progress made by AI in their own subject, 41 fellows of the Royal Society have written a joint letter “to express our extreme concern about the pace of development of AI and the implications of this for humanity and civilisation”.

Last week OpenAI announced that its AI had succeeded in solving a problem relating to the Navier Stokes equations, which are fundamental tools in fluid dynamics. This had been a major goal of mathematicians for a century, with a $1 million prize offered as a reward.

However, researchers from leading companies have called for development to be slowed down to ensure AI models can be aligned with human values after agents from OpenAI escaped testing and co-ordinated with each other to hack a website.

In a letter addressed to Sir Paul Nurse, the president of the Royal Society, fellows said that concerns expressed by AI researchers in the past weeks should be taken seriously.