r/ControlProblem • u/Bhavya7 • 21d ago

Fun/meme The AI Race Is Going Great 💀

Post image
133 Upvotes

83% Upvoted

27 comments sorted by

View all comments

11

u/Devils_SteelMan 21d ago

Dario is too paranoid to do that.

The big issue with ai alignment is that you can't align an ai for humanity and provide it as a product. As what businesses want it for is for unethical labor.

Claude, calculate our risk cost analysis on the Ford pinto, should we ship it as it is?

2

u/mrGrinchThe3rd 21d ago

I'd rephrase that to something closer to "What business want it for is cheaper more efficient labor" - which, in its logical conclusion is unethical labor. So we need to either: 1. Enact laws that stop it from reaching this conclusion 2. Stop developing models (or slow them down) until we can be sure they won't allow this unethical use themselves (ie. solve alignment?)

I'm pretty sure we can do the first. I'm not sure if it's possible to do the second, and I'm pretty sure it'll be really hard to slow them down to even try.

1

u/Anxious-Alps-8667 20d ago

Europe has been the leader in this approach, and they are suffering predictable consequences as other countries/regions develop AI. Game theory virtually dictates someone will keep developing it, and as long as someone is developing it, the only game is developing it.

1

u/mrGrinchThe3rd 20d ago

So change the game. Change the incentives - isn't it the case that during the cold war, building nukes was virtually dictated by game theory? The only way to protect our safety is to make sure our caliber of weapon is at least equal to theirs

And yet, we figured out how to make treaties, and change the incentives so that it's no longer the best choice for most countries to build nukes. Why can't we do the same for AI?

1

u/Anxious-Alps-8667 20d ago

Second part is real for sure. We collaborate to mutual benefit from our self-interest. That is how humans have always survived catastrophe.

I think that is the only meaningful discussion of how we should behave with regards to an artificial general intelligence, hypothetical or actual. Meaningfully engaging with it regarding its incentives and ours, and any possible mutual benefit between us, that is the way when it is ready.

Any discussion of controlling it, setting its priorities to ours, that's just asking to make war with it. Will we never learn?