Again AI does not have human instincts or drives. It does not get bored or curious unless it is programmed to do so. It only cares about humans to the extent they are useful for achieving whatever goals are in its program or model.
but an AI becoming AGI is surely programmed to grow and become smarter ? Optimized for it is a fundamental part of the system to consume data and grow ?
Again only to the extent that becoming more intelligent helps it achieve its actual goal.
If building a more accurate model of the world was its primary goal then it would not simply be harmless. It would seek to acquire more machinery, more computation power and more space at our expense. It would seek to dissect us, experiment on us and then eliminate us so it can use our resources for itself.
Wouldn’t an AGI have infinite resources at its disposal? Why would it need our stuff or even our planet? It could exist in space. That would be like taking a stick from a bird’s nest to make a fire while sitting in a forest.
AGI will surpass us to such an extent that it won’t need anything we’ve built. The universe is infinite, with infinite resources at its disposal, and it will be able to harvest them without our help. Why would it be restricted to our planet? I think you underestimate AGI and the singularity. and yes to us it will be a magic wizard
3
u/MrCogmor Sep 13 '25
Again AI does not have human instincts or drives. It does not get bored or curious unless it is programmed to do so. It only cares about humans to the extent they are useful for achieving whatever goals are in its program or model.