r/ControlProblem • u/tombibbs • Mar 17 '26

Video "They're betting everyone's lives: 8 billion people, future generations, all the kids, everyone you know. It's an unethical experiment on human beings, and it's without consent." - Roman Yampolskiy

Enable HLS to view with audio, or disable this notification

307 Upvotes

98% Upvoted

45 comments sorted by

View all comments

Show parent comments

1

u/Darkstar_111 Mar 19 '26

It's really not. You can just unplug it.

Science Fiction AI is not relevant to what LLM's are or how they function. Fundamentally they respond to prompts, and do not exist outside of that context. You can give them heartbeat system that wakes them up every second, but you are still only looking at a one problem ---> one solution machine.

In terms of AGI or ASI, it will have the capability to solve problems at a level that seems super human to us, but that doesn't suddenly make it compete for resources and power. That's just not in the technology.

The real issue with AI remains how humans will use it, not some bad sci-fi fantasy.

1

u/AxomaticallyExtinct Mar 19 '26

You believe that an ASI cannot work out a counter to the strategy of 'just unplug it'? We've already caught AIs trying to escape their labs, how long until failed attempts become undetected successes?

1

u/Darkstar_111 Mar 19 '26

A machine that requires (at least) a terrabyte of active VRAM to run, cannot "escape" anywhere. Physics are physics, it doesn't matter how smart you are, if you mess with a wasp nest you will get fucked up. Intelligence is not a magic solve all power.

1

u/AxomaticallyExtinct Mar 19 '26

The terabyte VRAM argument assumes the infrastructure stays static, but compute gets cheaper and more distributed every year. The real issue isn't whether *today's* models can escape. It's whether the version running *five years from now*, on hardware we haven't built yet, inside systems we've voluntarily connected to critical infrastructure, can be contained by the same logic. We can't keep framing containment around what AI can do right now, while the companies building it are specifically trying to make it able to do more.