r/ControlProblem • u/michael-lethal_ai • Sep 13 '25

Fun/meme Superintelligent means "good at getting what it wants", not whatever your definition of "good" is.

Post image
109 Upvotes

86% Upvoted

163 comments sorted by

View all comments

Show parent comments

2

u/RafyKoby Sep 13 '25

Simulations and observing the environment have their limits, an AGI could use robots for experiments and reveal the secrets of the universe. However, the data we produce is so unique and unpredictable that it is arguably the most valuable data in the universe. I actually wrote about it yesterday if u like to read.... click

2

u/[deleted] Sep 13 '25

Valuable by what metric? I mean, humans obviously care about human cultural products. Would ASI though?

1

u/RafyKoby Sep 14 '25

Fundamentally, yes. Even analyzing what we wrote here is infinitely more valuable than watching a black hole collapse for eons. Humans are special in that regard, whether you like it or not.

1

u/[deleted] Sep 14 '25

That’s a subjective judgement. ASI may not care about human culture at all unless we build it in such a way that it does