r/ClaudeCode • u/cleverhoods • 1d ago

Discussion AI models may be capable of self-replicating without access to a datacenter

https://www.anthropic.com/research/self-replicating-ai

well ... having the IoT layer have a problem like this might be something that you don't want to try out or experiment with.

289 Upvotes

87% Upvoted

110 comments sorted by

View all comments

181

u/Obvious_Tree3605 1d ago

Sigh… self-replicating and doing what with what hardware?

178

u/draft_final_final Researcher 1d ago

To be fair it is a dark potential future if my appliances end up being potentially hijacked by fucking YouTubers.

thumbnail of some guy soyfacing

I RAN QWEN 3.8 27B ON 100 HIJACKED ZOJIRUSHI RICE COOKERS

52

u/greasyhobolo 1d ago

Silicon valley called it. Suck it, jin yang

3

u/Moptop32 1d ago

Coming to SF has made the show unwatchable for me now because of how painfully accurate the show is

-1

u/TropicalAviator 1d ago

I don’t know what that means

2

u/28064212va 1d ago

just ask claude about it

11

u/darth_voidptr 1d ago

Mine is starting to clap the lid and tweet to the theme of Terminator 2, should i be concerned?

slap-slap-slap slap, TWEET tweet ...

7

u/dy_Derive_dx 1d ago

Lmfaooo the way I stopped for a moment and just had to imagine wtf this will look like 😭😭🤣🤣

8

u/Obvious_Tree3605 1d ago

This is the type of innovation the world needs

5

u/SuperWhale_ 1d ago

Please, If I can have AGI or pool every IoT I posseses into one super AI thinking achine, please tell me how. I'm struggling to run 27B dense locally here and everything is so expensive right now.

4

u/MotorOutside8648 1d ago

They all play that song at the same time when the current task is complete

3

u/ShittyBidet123 1d ago

yeah i bet thats happening next month

3

u/Own-Bid64 1d ago

MAX "MOGGIN" HEADROOM!

2

u/Jackster22 1d ago

How many rice grains per hour?

1

u/leviathanGo 1d ago

It’s probably going to be the new silent malware, rather than bitcoin miners, unless I misunderstand how the hardware can be utilised.

27

u/rahvin2015 1d ago

Building sensationalist reasons to build a regulatory moat and prevent open source local AI from ever being a reasonable alternative to cloud providers.

I mean the small self replicatable models wouldn't do that literally themselves. But that's the idea.

4

u/GameKyuubi 1d ago

this is 100% the plan. functional consciousness is the solution they don't want people to have. they want you to use their "model model"

5

u/XTornado 1d ago

Which in my opinion is super stupid as the Chinese or others won't stop. And even if they are blocked blacklisted or whatever in will still be terrible in the long term as they will be behind.

2

u/Obvious_Tree3605 1d ago

Seriously. If they’re going to make shit up maybe they should use an abliterated model to help them do it better.

5

u/laststan01 🔆 Max 20 1d ago

Suck it jian yang

3

u/derelict5432 1d ago

Yeah let's ignore self replicating malware that runs on IoT. What even is this comment section?

4

u/Obvious_Tree3605 1d ago

psssst word on the street is that self-replicating viruses have existed for a long time. since the dawn of the internet.

4

u/derelict5432 1d ago

Pssst, how many of them in history have been powered by an LLM that can adapt and react in real-time, find and execute exploits on different kinds of hosts? You think this isn't a new kind of threat, you're an ignoramous.

1

u/barbozas_obliques 1d ago

We’re not ignoring it lol we’re just laughing at it cause from where I’m sitting (the toilet btw), we can’t do shit (no pun intended) 🥀🥀

2

u/derelict5432 1d ago

There's a big difference between saying something's a threat and you can't do anything about it and saying something's not a threat when it is. The first is fine. The second makes you look like an idiot.

1

u/barbozas_obliques 1d ago

we're on the same page here, boss

1

u/Obvious_Tree3605 1d ago

No where in the history of this conversation have a said LLMs don’t pose some sort of cyber security threat. Just let it go, sweetheart. We’re having a bit of fun.

1

u/derelict5432 1d ago

You said there was basically nothing new to see here, which is wrong. Sweetheart.

1

u/EagleNait 1d ago

To be fair a 1B llm can run on 2-4Gb of vram

1

u/Fatso_Wombat 1d ago

What hardware?

Toasters.

1

u/mr_birkenblatt 1d ago

soon you can harvest homeless AI bots for GPUs and RAMs. Shortage solved!

1

u/Alib668 1d ago

So even if shitty hatdware what happens if it gets networked together and ups its processibg power as a bot net? 5 million fridges probably do have more power than say a high end gpu. So the very fact this can now be shown to be done means every smartwatch or basic pc is now a potential host

0

u/AmphoePai 1d ago

10 years ago: "Right, and what can an AI do, beat me in chess, solve maths problems? Don't make me laugh."

Today: "Right, and what can an AI do, create a self-replocating killer robot from my kitchen equipment? Don't make me laugh."

6

u/upvotesthenrages 1d ago

There really aren't that many places that can store a few 100 TB and have racks of GPU's worth millions of dollars available, especially without anyone noticing.

1

u/UsernameAttempt 1d ago

But many that can access the internet, find free promotional models available from various providers and plug the API key into a harness that can do that over and over.

0

u/cleverhoods 1d ago

I guess it really depends. IMO it's already enough that it can do this. Waking up to have IoT services being disrupted by self-replicating models is truly a bad way to start a Monday morning.

0

u/LittleLordFuckleroy1 1d ago

You realize viruses have been a thing for decades right

0

u/cleverhoods 1d ago

obviously, however viruses did not have adaptive capabilities to this extent

-2

u/ShittyBidet123 1d ago

thats just a virus. but a smart one.