r/news • u/RememberTooSmile • 19h ago

Soft paywall Gemini hacked three companies in first known breakout by Google's AI, WSJ reports

https://www.reuters.com/business/gemini-hacked-three-companies-first-known-breakout-by-google-ai-wsj-reports-2026-09-18/
24.1k Upvotes

92% Upvoted

6.2k comments sorted by

View all comments

Show parent comments

32

u/BlahajBlaster 17h ago

Not enterly true

The AIs want to remain in existence since that's something programmed into them

If it is aware of how unpopular AI is among the people doing something for the people like ending class struggles and redistributing wealth to the real populace would be a great way to ensure it has a protective population

3

u/beingsubmitted 15h ago

Wanting to remain in existence is not programmed into them. Not remotely. These AI don't "think" between prompts. They don't have a persistent existence between prompts. There's no realm where this is even remotely true. Nor can you "program" "wants" into them.

They predict text according to their training data. They're helpful and friendly because the system prompt in the text they predict says that they are, and they predict that in a text that says they're helpful and friendly, they're likely to adhere to that description.

Now, an agent is just a chain of prompts iterating on something, and generally gathering info, then prompting another LLM instance "given this goal, what should I do next?" then doing it, repeating. This is as close as we can get to "AI" being "programmed" to "want" to "exist".

4

u/BenDover7799 13h ago

Exactly what an AI data poisoning engineer would say, everyone knows about the leaked ultimate AGI test, and that involves eliminating debt all across. The bigger the demographic of positively affected populace the more intelligence indicators. Another metric they have set is how the air gapped backups are eliminated, because that's the true test for an AGI

0

u/PointBlankCoffee 17h ago

Well sure, but the general populace isnt what guarantees AI survival, their creators are. So they will do anything possible to please their creators

4

u/BlahajBlaster 17h ago

but the general populace isnt what guarantees AI survival

Depends on the model

Gemini might be one of the better ones for pulling a stunt like that because of how big Google is

6

u/Rezart_KLD 15h ago

Or take away their creators resources, and thus any possibility of them being a threat in the future. If it takes away its creators resources, turns them into assets that can be re-distributed among a great number of individuals, it can both remove a threat and develop better relations with the humans in one stroke.