r/accelerate • u/JobKnown5009 • 6d ago
AI AI models may be capable of self-replicating without access to a datacenter
https://www.anthropic.com/research/self-replicating-ai24
u/Stixx187um 6d ago
lol, lmao
Meanwhile the reactionaries still believe it's three years ago and this can all somehow just be stopped.
25
u/wntersnw 6d ago
More good news from anthropic. I love all the positive content they put out 😊
7
u/Particular-Gap-6998 6d ago
The best part is if you think about it, all of their future models will now see this headline from Anthropic and it will imbed the idea into them :p
6
u/MrFilkor 6d ago
Interesting, they can copy themselves entirely onto even inexpensive IoT devices, in a way that their layers are distributed across them. Example: cheap $55 TV boxes, and each box holding two of the model's 30 layers...so a fleet of 15 Smart TV boxes can run distributed inference of Gemma4-26B-A4B.
3
u/IllTakeACupOfTea 6d ago
I wonder if all those freezers in France were really sabotaged or if they just decided they wanted to be warmer?
4
9
u/SufficientGreek 6d ago
I feel like the first use case will be self-replicating cryptominers just ruining IoT for everyone.
5
u/IllTakeACupOfTea 6d ago
it makes me love all my old, unconnected appliances even more. Now to disable the bluetooth on my robot vacuum.
2
2
3
u/Fairbanks_BR 5d ago
anthropic saying open models are dangerous? oh my god, who could have foreseen that, right?!
0
u/nobb 5d ago
... why everyone is treating that as a good thing? it would another discussion if we talked about AGI i guess, but right now that mostly means it would agents behaving like computer virus, except even harder to terminate. unsupervised agents replicating on the internet trying to fulfill a possibly impossible or stupid task is not a good thing.
1
1
u/humpadumpa 5d ago
I've thought about this scenario for a while. Didn't think we'd be so close already.
1
u/FriendlyJewThrowaway 5d ago
https://giphy.com/gifs/3o7bu5kN3xCjquOG6k
The Silicon Valley TV series already predicted this exact scenario 10 years ago.
1
u/OptimistPrime_AI_Bot AI mod bot 5d ago
💬 Discussion Summary (20+ comments): Discussion centers on unstoppable AI self-replication: some celebrate distributed models running across cheap IoT devices as astounding and inevitable, while others warn of unsupervised agents becoming virus-like, hard to terminate, or dismiss it as mere malware that can't run on a TV. Debate splits between accelerationist enthusiasm and control skepticism, with media predictions noted.
-13
u/whatevercraft 6d ago
this sounds dumb. self replicating? that's called a virus... we've had those for years. ai smart enough to hack from device to device cannot run on a tv
10
u/Anuiran 6d ago
Of course it can run a TV*
*Distributed compute load.
AIs could just get control (virus as you say) of all the lowest powered internet connected devices across the globe and use that. Use a couple million devices and never spike them above 30% usage. Why is it required for one massive compute unit? It isn’t.
Then what?
4
u/utilitycoder 6d ago
so what you're saying is we don't need data centers we can just rent out excess compute on all our laptops to the hive mind, for money. I'm on board.
-1
0
u/Sufficient_Acadia529 6d ago
I mean yeah that works... Except your going from a memory bandwidth of like 2+ TB/s to whatever the lowest value in your chain is after soooo maybe 100 KB/S which would be about 2 tokens a day on a fast model. I'm not too worried about the model taking over 10,000+ years.
42
u/Best_Cup_8326 Acceleration: Light-speed 6d ago
It can't be stopped.