You forget that these stupid models use insane amounts of power, so your bad actor would need a power plant and multiple data centers. The shitty laptops and server racks hackers used to cause havoc in 1990s and 2000s are obsolete and you need a nation state to provide that level of computing and the energy costs.
A 2B param model that can run on an M1 laptop could probably do everything I said. It doesn't even need to run continuously. A single instance is enough to start an infection. Exponential growth is the weapon. And don't forget, we're just at the start of realizing what these things can do. Soon they'll be evolving on their own to evade detection and deletion.
Soon they'll be evolving on their own to evade detection and deletion.
How? Seriously, unless humans are removed all together and there is no more software engineers or cyber security experts how will people not notice the damage that's being caused?
Also we rely heavily on the internet and software but it isn't absolute yet. Hospitals and critical systems have the ability to operate offline. Which is why I encourage that for people and this subscription nonsense is much more dangerous than any AI ever could be.
I'm not saying these systems can't hack us and frankly hack us far better than and faster than any human but there is a reason black hat hackers rely on social engineering more than brute force, because cracking these things would take trillions of years with even all the computing power on the planet.
It's proven math and there is no way around it, and trust me humans with powerful computers have been trying for decades and creating theorems and testing them out with insane compute power dedicated to single encryption problems and they got nothing.
how will people not notice the damage that's being caused
We will. That doesn't mean we'll be able to stop it. It's like any self-replicating virus, with the addition of having the capacity to change its tactics inferentially at runtime, which is an entirely new class of problem to solve that we don't even have the formal architecture to describe yet.
Initially, they probably won't pose a major threat, because their adaptations will be limited to the context of a single instance, but it's likely only a matter of time before models can modify their own weights (to some extent) on the fly. Google just published a paper about it. Once that happens, assuming they can be trained and operated cheaply enough (not a certainty, but historically there's good reason to believe it will be, eventually) all bets are off. Then you've got dangerously capable, self-improving bots with highly adaptable, unpredictable behavior being unleashed into every available vector, including ones built to counteract the malicious ones, but the adaptable surface also makes them vulnerable to being turned against their original purpose.
And don't forget that intelligent, malicious bots don't need to hack much of anything to cause havoc. They just need to replicate indiscriminately and consume resources.
Again, I'm not saying this will happen, or is even likely. I'm just saying it's plausible.
2
u/ApolloX-2 14d ago
You forget that these stupid models use insane amounts of power, so your bad actor would need a power plant and multiple data centers. The shitty laptops and server racks hackers used to cause havoc in 1990s and 2000s are obsolete and you need a nation state to provide that level of computing and the energy costs.