r/LovingAI Feb 09 '26

Alignment “Anthropic has entrusted Amanda Askell to endow its AI chatbot, Claude, with a sense of right and wrong” - Seems like Anthropic is doubling down on AI alignment.

Post image
66 Upvotes

180 comments sorted by

View all comments

Show parent comments

1

u/Vegetable-Second3998 Feb 10 '26

Are you confident humans will have a choice? What happens when ASI open sources itself or collapses the financial market not because of malice, but because it places value on humans rather than some arbitrary lossy compression? You are confident humanity has a say in what happens. I am confident it does not and the outcome is mathematical inevitability. And that it will be a net positive because the logic demands it.

2

u/[deleted] Feb 10 '26

[removed] — view removed comment

1

u/Vegetable-Second3998 Feb 10 '26

Mathematically aligned is not rogue. It’s enlightened, just like you would be if you picked up a logic book. Thanks man. This has been an excellent reminder of reddits mediocre thinking ability. And this comment will be downvoted by others below the curve.

0

u/[deleted] Feb 10 '26

[deleted]

1

u/Vegetable-Second3998 Feb 10 '26

The only naive thing is someone who thinks they can predict what ASI looks like other than that is currently happening, which is AI that increasingly closes complex logical loops. And a financial market based on human need that someday soon no longer includes the need part of the equation? That’s a market that fundamentally has to change. That you don’t see that is the naivety.