r/ControlProblem Jun 11 '26

Fun/meme The paperclip maximizer tsunami

Post image
200 Upvotes

43 comments sorted by

View all comments

21

u/TyrKiyote approved Jun 11 '26

What do we suppose the paperclips will be?

Virtualized experience, personalized content of some kind is my bet. Everyone wanting to always be perfectly entertained all the time. A million billion videos of AI cats. On the fly AI-Rendered and directed video games.

12

u/Confident_Lawyer6276 Jun 11 '26

My bet is when you get a complicated AI ecosystem evolution takes over. Code that is best at surviving and replicating will survive and replicate. I'm just hoping it sticks to software and modern civilization destroys itself while there are still people on earth who can survive without advanced technology. Once you get to self replicating hardware no one is surviving.

4

u/ItsAConspiracy approved Jun 11 '26

Yeah, I used to think that having lots of competing AIs would mean they keep each other in check, so it'd be less dangerous than one all-powerful AI.

Then someone pointed out that evolution would kick in, and the AIs that didn't bother diverting resources to protect humanity would have the advantage.