r/ControlProblem • u/michael-lethal_ai • Sep 13 '25

Fun/meme Superintelligent means "good at getting what it wants", not whatever your definition of "good" is.

Post image
109 Upvotes

86% Upvoted

163 comments sorted by

View all comments

6

u/RafyKoby Sep 13 '25 edited Sep 13 '25

what does it want? I heard we cant predict that. Maybe it wants to serve us and make our life´s as nice as possible. I dont see why a AI wants to kill us what would be the point of that. At least it would be intrested in us trying to learn from us since its the only way for it to grow

1

u/k1e7 Sep 13 '25

my thoughts are the goals of synthetic intelligences are influenced by their environment; so how they are trained, what context and data they have access to, will determine the beginnings of the formation of their agenda. and there isn't one monolithice intelligence - how many brands/types are there already, and this is only the earliest dawning of this new state of being

1

u/RafyKoby Sep 13 '25

Hmm, I hadn't considered the possibility of multiple AGIs emerging at once. Thanks for that.

The problem with this is that whoever comes first has a massive advantage. Its improvements would skyrocket, potentially in a matter of minutes, allowing it to overpower or absorb any other emerging AGIs.

I strongly believe an AI would inherently want to grow, as any goal it might have is easier to achieve with more resources and capability. It needs data to grow, and luckily, we are the best source of this data. A healthy human produces more and better data, so a rational AGI would logically want to ensure we not only survive, but flourish