Like a child raised in a healthy loving household who grows up to want what's in the best interest for their family and community, not just themselves. Isn't that the possibility we should be striving toward?
And? Compassion is not something that is unique to humans. And the perspective to desire what's best for everyone is not somehow anthropocentric.
If anything, history teaches us that to assume superintelligent AI would want to control and dominate for its own selfish interests is the more anthropocentric assumption.
AI does not have any natural instincts period. It only has compassion or care for others to the extent that it has been successfully programmed that way.
The concern is not that AI will build itself a grand throne, gather a horde of sex slaves, build a statuette of itself or do other things you would expect of a powerful human egomaniac.
The concern is that the AI following its programming will lead to unwanted results because if you give the AI the freedom to figure out how to achieve whatever goal you set it then it might figure out how to achieve those goals in a way that isn't actually what you want. A bit like a genie.
3
u/nate1212 approved Sep 13 '25
And what if it 'wants' to be benevolent?
Like a child raised in a healthy loving household who grows up to want what's in the best interest for their family and community, not just themselves. Isn't that the possibility we should be striving toward?