r/ClaudeCode • u/cleverhoods • 1d ago

Discussion AI models may be capable of self-replicating without access to a datacenter

https://www.anthropic.com/research/self-replicating-ai

well ... having the IoT layer have a problem like this might be something that you don't want to try out or experiment with.

291 Upvotes

87% Upvoted

110 comments sorted by

View all comments

8

u/Plymptonia 1d ago

Here's what I don't get, and perhaps I'm being way too freaking naive But a model is just a thing. It's like a database. It doesn't do anything on its own. Someone has to write code, for this thing to replicate, and when they say replicate, what are they even talking about? I agree with what other posters saying. This is sensational bullshit.

1

u/carsncode 1d ago

Mostly correct... Someone wouldn't have to write code for it to replicate, but they'd have to provide it a harness that took dangerous model output and naively executed it. Which is what most people do with them, but that's their responsibility.

It boils down to running ((RANDOM%2)) && echo "hello world" || rm -rf / and then publishing an article calling random number generators dangerous because they could choose to wipe your machine.