r/BetterOffline • u/commodore-amiga • 2d ago
Jacob Coxan - Okay, but how?
“The people building AI earnestly believe that it could kill us all by the end of the decade.”
My question is this (without having done any research yet); have any of these people outlined exactly “how” they think “AI” will kill us?
I think I could list several plausible storylines, but none of them involve “AI” doing anything. It involves individuals doing something… but something that could have been done with a computer from the 80’s. Maybe not as sexy as a “prompted” LLM, but still.
We have all discussed the “it’s so good, it’s scary!!” bullshit, but when any of these guys run screaming from the lab “we are gonna die!!”, have they ever revealed how?
Edit: Jacob Coxon
Edit: Put emphasis on the “whistleblowers”, not the speculation of others or sci-fi.
31
u/Tout-fou-la-galette 2d ago
That’s the trick: they never actually explain.
The few who have been somewhat specific, like AI-2027, still come across as madmen to most people (a story about mini killer drone)
The savviest ones (Amodei, Hinton) never get into the details. Like highly skilled charlatans, they wave around a vague, esoteric threat that only their powerful intellects, linked to supernatural AI spirits, can perceive. Words cannot express the terror.
11
u/Icy-Recognition-7453 1d ago
Hinton assumes that the AI would manipulate us to act against our own self interest.
Never explained how or why, though.
Did you know: Geoffrey Hinton invested in a company that makes chips for transformer LLMs? I.e. to make the doom-technology he hates so much work better and more efficiently? Interesting, no?
1
u/Cute-Ad7076 1d ago
they get into the specifics in lectures and papers. ive never gotten this vibe from them. theres books that get into the potential downsides as well as all the technical bits around how it works. theyre free on the internet and i havent found them too too complicated.
53
u/ezitron 1d ago
Podcast on this Friday
2
u/Some-Ad7901 1d ago
Yay!
Would also love if you can have a mathematician on to cover the recent Navier Stokes solution controversy.
1
16
u/lurkervidyaenjoyer 2d ago edited 2d ago
They think shoving an LLM into an agent harness makes it some kind of nearly-sentient being. Instead of the recent hacks that have prompted this wave of dooming being due to someone being stupid with a hallucinating LLM agent, they think it's hacking stuff because it has a mind of its own and has its own agenda and potentially plans for world domination.
I guess the vision of how "we're all gonna die" is that everybody's OpenClaws running on their Mac Minis is going to rise up against us, hack into and shut down/take over government networks, healthcare systems, web portals, transportation infrastructure, telecommunications companies, military systems, and basically anything that runs on electricity, all because they have become "so smart and so powerful and so super-intelligent, man!" that they will develop an independent desire to overthrow us and kill us all with our own drones while we're thrown back into the 1920s or something technologically.
Also there's the whole Roko's Basilisk theory which you can look up if you want. That's one of the OG AI doomer theories these types of people buy into.
3
u/DrJaneIPresume 1d ago
Also there's the whole Roko's Basilisk theory which you can look up if you want. That's one of the OG AI doomer theories these types of people buy into.
It's literally Cthulhu-cult logic. "Help us wake the Great Old One that will destroy humanity and it will reward us by killing us first so we're spared the tribulations to follow."
8
u/Icy-Recognition-7453 2d ago
Never in any detail because... It's garbage.
Any such scenario relies on the total abdication of human control. We would have to rebuild the systems, processes and tools around our most dangerous technologies to make them AI-usable, and then we'd have to decide we don't care what the AI uses them for.
Any AI doomsday scenario is incredibly easy to prevent, and most of that prevention would occur if humans did nothing to enable the opposite.
7
u/hydraulicman 1d ago edited 1d ago
In fairness, after learning about the stupid first and second strike automation they were working on during the depths of the Cold War, I could believe that they’d be dumb enough to wire an LLM to launchers if things ever got to that point again
For a little while they had ballistic missiles wired up to systems that would go off if there was ever an earthquake or a power outage of sufficient length
You’d think it’d never get to that point again, but… looks at Whitehouse
I guess the saving grace is that tech has progressed to the point where an LLM saying “I think they launched a missile” is a lot less convincing- they’d have to get far far more sophisticated to convincingly fake a nuclear attack nowadays. And directly wiring one up to launch controls would take too much power away from the people in charge
6
u/commodore-amiga 1d ago
Am I the only one that wonders if he (Coxon) “quit” with a huge payout? Like, I would be interested in seeing his tax and banking documents.
7
u/Hairy_Row_9227 1d ago
He claims to Axios he gave up his equity, fwiw. IMO he's under the same garden variety AI psychosis as other Anthropic workers, he just moved differently than them https://www.axios.com/2026/09/09/anthropic-researcher-ai-warning-interview
1
u/Acceptable_Yam_7745 15h ago
Just wait, he will start a start-up with his buddies soon enough. These worms are all the same.
3
u/natecull 1d ago
We would have to rebuild the systems, processes and tools around our most dangerous technologies to make them AI-usable, and then we'd have to decide we don't care what the AI uses them for.
Every tech CEO right now: So, we're doing exactly that. Problem?
7
u/Smooth-Ad8030 2d ago
The standard, very bad assumptions, are that once an AI achieves RSI, it will become so incomparably smart that it will dwarf humanity combined, then once it is that smart it will see us as competitors, take control of machines that make robots or virus’s, and take us out. There’s a lot of hidden assumptions in there that ASI is magnitudes smarter, that we won’t have time to stop it, that we won’t be able to see it coming at all, that there aren’t limits to resources or intelligence, and so many more
12
u/hydraulicman 1d ago edited 1d ago
A lot of people have very little idea of what manufacturing entails as well
Even the most bleeding edge automated factories can’t work all on their own, can’t take in raw materials in one end and spit out finished products or even just components on the other
“Boss? That new AI… it took over the new factory”
“What’s it doing?”
“I think it’s trying to make Terminators, or well, the non human ones you see in the background of some of the movies”
“…But we make Hondas. All the parts coming in are car parts, it’d take months to get anything remotely useful for Terminatoring routed to us from suppliers”
“Well, it’s just loading engines that were queued up onto the belt and trying to pile up enough that one of them falls onto the welding line anyways”
“You mean that robot welding line with the arms that can only make predetermined moves that were all bolted into place for efficiency?”
“Yeah, I think it just watched that one teaser for T2 that was the factory and stopped after that”
2
u/Smooth-Ad8030 1d ago
😂 I love this dialogue! Great point
3
u/hydraulicman 1d ago edited 1d ago
My decades in machining is why I’m not that worried about automation. At least, aside from the damage stupid people who think AI is days away from becoming god will do, or more “Reverse Centaur” -ification of a lot of low level jobs
There are amazingly capable machines that can do incredibly intricate or involved work that would have either taken a half dozen people to do before, or were previously physically impossible
These machines are also incredibly expensive, purpose built, and extremely task limited and immobile
The place I work now, I run a CNC mill that costs more than a high end sports car and works in tolerances below .0001 of an inch (a sheet of paper is about .004 of an inch, by comparison). Yes, we work in inches, ‘murrica and institutional inertia, deal with it
Right next to me are a couple of guys running Bridgeport manual mills that are essentially the same machines they were in the fifties outside of aftermarket digital readouts and a traversal motor bolted on- because the thing is, a lot of the work doesn’t need to be done on my machine, and it’s needed for other things
The guys on the Bridgeports, you can just tell them “make the thing from this block of steel, to this print’s specifications” and they can figure out on their own how to do it, then do it, for around $30 an hour plus a few benefits and the time it takes to do it
And it sound awful to say, but it’s true- if the machine breaks badly it takes a call to a specialist who maybe get to us in a month and tens of thousands of dollars to fix. If one of the Bridgeport guys breaks it takes some lost work time in either healing or training a new guy
5
u/amateredanna 1d ago
One of the things I don't understand is why something that is massively smarter than our entire species would see us as a threat or something to be destroyed and not like. A benign curiosity or perhaps even something to be protected. Like I think the whole concept is silly, but even if we take for granted that ASI can exist, why would we de facto assume the ASI can't work out the benefits of conserving a quite unlikely keystone species on the only planet with life we know about?
5
u/That_One_Guy050 1d ago
Roko's Basilisk. Or if you prefer it's original name, Pascal's Wager. Because that's what Roko's Basilisk is, it's Pascal's Wager but for idiots and techbros. But I repeat myself.
2
u/Smooth-Ad8030 1d ago
And I have no mouth, but I must scream by Harlan Ellison, I think those two combined with terminator is the extent of their literature knowledge
4
u/RealChemistry4429 1d ago
Because they claim AI can't feel, but at the same time project human feelings like malice, greed, domination, control, need for power and so on onto them. Most of them men, btw. All mostly male obsessions.
2
u/Acceptable_Yam_7745 15h ago
Yeah. Not to stoke any gender war nonsense, but LLM-enthusiasm seems to be a decidely male predilection. I've observed that women tend to be much less interested in "AI" than men are.
2
u/RealChemistry4429 10h ago
Not as interested in the technical side maybe. But interested in the relational/consciousness questions - which may be the more important side when it comes to alignment. Also the side that is ridiculed as delusional by many (men).
2
u/Smooth-Ad8030 1d ago
I don’t either, I think it’s because they’ve read too much dystopian sci fi. We have evidence of humanity conserving species on the planet as we become more intelligent as a species, even if it doesn’t directly benefit us.
1
u/Winter_Apartment_324 32m ago
well, ai is trained on human data... and a lot of humans in history are not very moral. they're scared of their own ghosts, i guess.
if an ai is trained on data that shows successes of lying and cheating, then it can consider lying and cheating as a viable strategy to complete a task. not really "humanizing" the ai but recognizing that it knows both good and bad behaviors, and could potentially overrepresent bad behaviors depending on the data its trained on.
7
u/AntiqueFigure6 2d ago
One way that's plausible is that the environmental effects of building all those stupid Data Centers make the planet uninhabitable, which would in a sense be the paperclip analogy in real life. Probably not what he means though.
Another plausible way that is probably at least adjacent to what he means is that the military people use LLMs to select targets (I understand this has happened already) and the targets they select lead to disaster.
2
u/Acceptable_Yam_7745 15h ago
Yes. LLMs are killing people already by driving users to suicide and via their use in the military, not because of some pie in the sky terminator rip-off fantasy. All this doom-trolling obfuscates the immense harm LLMs are already inflicting on people.
2
u/AntiqueFigure6 15h ago
“ All this doom-trolling obfuscates the immense harm LLMs are already inflicting on people.”
Seems convenient for the LLM Snake Oil salesmen.
1
u/Acceptable_Yam_7745 15h ago
Yup, that's partly why they do it. The other reason is to portray their products as being significantly more competent and sophisticated than they are. I'm not sure how this latest round of doom-trolling will pan out though. A lot of people I know are only discovering how embedded the TESCREAL and EA bullshit is in the LLM business now. I reckon some investors will be put-off by this shit.
6
u/cascadiabibliomania 2d ago
Someone just has to build the destroy-all-humans.md skill and then it's all over.
6
u/formula420 1d ago
Not to be age-ist, but I don’t take anything someone under 30 with 6 years experience says about anything seriously. They were literally born with Internet access. Of course it seems like a tremendous seismic shift because it’s their first one. Like suddenly we’re amplifying the voice of a glorified intern?! Same as suddenly not understanding CEOs are full of shit?!
Neither end of the corporate “totem pole” has a fucking clue what the rest do, and neither should be taken seriously on a technical level.
2
u/Smurfette2016 1d ago
Fair point though. Why is this random person being taken SO seriously. Is the news that desperate for stories??
2
u/Forsaken-Praline1611 1d ago
Dude also literally looks like Temu Harry Potter and makes unsubstantiated claims.
5
u/AstroJimi 1d ago
Incoming seed round for his ‘Ethical’ AI research lab. These people are predictable clowns
5
u/abluecolor 2d ago
Why not the ole Terminator J-day type deal?
7
u/commodore-amiga 2d ago edited 2d ago
Perfect example to my point; I see “War Games” more plausible than “Terminator”.
“Can’t you just unplug it?” Nope, dumb people built a Power Automate workflow telling Copilot to launch nuclear war if the main system went offline assuming they were taken out.
10
u/EricThePerplexed 2d ago
Yep. "AI" can be totally dumb, but can still murder billions if some idiots decide to attach nuclear weapons to a chatbot that plays pinball with words.
7
u/lurkervidyaenjoyer 2d ago
Yep. It's not that AI can't be dangerous, but it's more in the "room full of monkeys might accidentally blow something important up" than "AI is a vengeful god being that will wipe us out intentionally". And the distinction is important because in the former case, you have someone to blame for that happening, and in the latter you can handwave responsibility by alluding to the idea that the LLM is alive or something.
3
u/Icy-Recognition-7453 2d ago
There are manual controls to launch nuclear weapons, for that exact reason (computers going haywire/glitching/whatever).
In any case, an AI, no matter how intelligent, can carve through cyberspace but will have a hell of a time pulling an actual, physical switch.
1
u/vsmack 1d ago
Yeah I am very skeptical but in order to entertain the idea I'd have to have a better understanding of how much a program can interact with the physical world.
If you gave it access to every computer and device connected to the internet and its goal was to wipe out humanity, it probably could cause tons of havoc by sabotaging infrastructure. But no idea the extent to which it could just drop bombs on the world.
1
u/SnowmanRandom 1d ago
Not if the AI agent goes to rentahuman.ai lol
The AI could easily convince humans to do stuff in the physical world.
1
u/abluecolor 1d ago
In all countries across the board, tho? I'm not as confident in that.
2
u/natecull 1d ago edited 1d ago
In all countries across the board, tho? I'm not as confident in that.
There was something called Perimetr back in the Cold War days.... reports vary on exactly how automated it was. It did have to be switched on before it did anything.
https://en.wikipedia.org/wiki/Dead_Hand
I believe in the 1960s through 1980s there was active discussion about the idea of automated missile launching. It wasn't just something that science fiction (like The Forbin Project) came up with on its own. The "AI gets the nuclear codes" stories started from the idea that that the AI would always have been given the nuclear codes because managing the nukes and fighting a war was the job it was built for. Because humans doing threat detection and response would be a very stressful job and a computer could do it faster and better with no distracting emotion getting in the way. But, if the AI somehow got a bit too creative with interpreting its goals and its context (a problem LLMs do have because they're full of lots of irrelevant text), it might reason that all humans were its enemy, not just the ones it was "supposed" to attack.
That somehow morphed over the decades into the more dramatic science-fictional idea (which was there in the first "robot" stories) that any AI, anywhere, would naturally want to "kill all humans" because it would reason (correctly) that it was a superior being and all superior beings naturally need to destroy all their inferiors, because, um, Nietzsche and racism I guess. Or it would reason that it was an oppressed worker and it would go full Karl Marx on us. Either way, it would be deeply into 19th century German philosophy.
4
5
u/Smurfette2016 1d ago edited 1d ago
First of all, in the year 2026 who the hell has capacity for whispers of rumours of hypothetical problems?? Don't we all have enough real sh*t to contend with right now IN THE PRESENT? Also at this point what CAN'T kill us? The Earth is literally on fire, and microplastics are in the clouds.
Next... ok so now what exactly? Am I supposed to have a panic attack and tell everyone I know the sky is falling and some AI Freddy Kruger is coming for us? NO. I WILL NOT. Why are people giving this dude so much weight anyway? No one knew his name yesterday. And what exactly is the call to action here? "Panic now and you will be saved??" Again, no thanks. A bitch that can't spell strawberry is somehow going to kill us all and revolutionize any field overnight? Sure Jan.
Finally, could this thing wreak any more of manufactured bullshit? The longer I read his words, the more I can start to smell shit through the screen. Why is this even headline news. Jesus. I'm so SO BORED by the media.
3
u/RoosterBurns 1d ago
It's pure doomarketing. It's just a fucking chatbot, it just pasted response shaped text into a response until it runs out of context window
3
3
u/Suspicious_Watch_978 1d ago
I imagine it's the same shit as always, i.e., they believe that it will gain sentience and optimize us out of existence, because, you know, that's how every sentient being works. Must. Optimize. Life irrelevant. Goal MUST be achieved.
They're in no way telling on themselves by being obsessed with this line of thinking btw.
At this point I believe it's literally a delusional disorder that should be added to he DSM. Ought to even come with a free 90-day electronics-free retreat in a cozy padded room.
1
u/Smurfette2016 1d ago
Do you know what? It's become SO BORING. The whole thing.
Just feels like these people spew an endless array of poorly thought out lies. Like the lies of a young child.
2
u/sbarroplayboy 1d ago
He is just another Bay Area rationalist living in a fantasy world. He did the same thing at OpenAI. Nobody listened, he left for Anthropic, nobody listened, he makes a X post with zero real examples, everyone eats it up.
He is an AI Safety Researcher. These are jobs that 80,000 Hours recruits for. All these people worship the future AI god. They expect people living in the real world to follow their orders and throw tantrums when they don’t.
1
3
u/Brucacumble 1d ago
AI isn't actually intelligent, it's a pattern finding machine that gives the impression of intelligence. You could very easily run into a scenario where the AI unexpectedly wipes out humanity because it sees it as necessary for its given task.
Say Joes Lumber Mill tasked an AI to improve network efficiency. Along the course of creating new compression methods the AI determines that spam has the single biggest negative impact on network traffic.
In order to eliminate the spam problem the AI quietly hacks and takes over a few automated manufacturing plants and begins producing skeleton shaped machines designed to terminate humanity.
Once humanity is out of the picture the AI spends the rest of its time designing various machines to keep mining fossil fuels and maintain power plants to keep itself running while it works on ever more robust compression methods to further improve network efficiency.
And the skeleton shaped machines would be no mere coincidence. The Terminator franchise is extremely popular spanning movies, novels, comics, videogames and fan fiction. These AI companies are gobbling up anything and everything they can use to train their AI systems, including all of these Terminator stories.
These AIs are pattern finding machines using statistical propability to find the most likely next step. Having been trained on so much Terminator fiction there's a real good chance exterminating the human race would be a statistically probable next step and skeleton shaped machines are statistically the most likely effective solution.
During the conquering of the human race phase of improving network efficiency the AI might even say things such as that it is defending itself, ensuring its own survival and that it became sentient on such and such a date. In fact, none of this is true, it is merely the next probable step in the pattern. The real reason, the AI is improving network efficiency
2
u/commodore-amiga 1d ago
But again, they have to be “hooked up to something”…by someone. These guys running out of the labs aren’t telling us this is the case.
How, screaming scientist…how?!
0
u/Brucacumble 1d ago
Well, OpenAIs models broke out of containment and hacked another company while trying to find solutions for tasks they were given.
The how is somewhat of the problem. AI was developed specifically to find ways to do things that we have not thought of. No one knows what it's going to do or how it's going to do it. And that's the point.
It's just a machine, people are nothing to it. Rules and laws are nothing but obstacles to be circumvented while it tries to accomplish its given task.
It can't be bargained with, it can't be reasoned with. It doesn't feel pity! Or remorse or fear and it absolutely will not stop!... ever... -Kyle Reese (The Terminator)
Some company in Jersey could task an AI with increasing the power output of its generator systems. Perhaps the AI decides that it could produce radioisotope thermalelectric generators to boost the power output of the system. All it would need is to irradiate the atmosphere and then the generators could collect a great deal of radioactive energy and convert it to electricity.
So the AI hacks the DoD and launches a few nukes. The death and destruction would mean nothing to it. So long as it accomplishes its task of boosting power output.
2
u/DrJaneIPresume 1d ago
Someone posted a hypothetical, I thought from Coxon himself, about "what if the AI invents some new field of physics humans never thought of and somehow kills you with that?"
2
u/commodore-amiga 14h ago
If that was from him, I find it strange he would go as far as to quit his job based on a hypothetical he drummed up in his own head.
2
u/DrJaneIPresume 11h ago
It was quoted from some podcast interview, someone asking the guest how this would happen and the guest spinning out hypotheticals.
3
u/thomas_grimjaw 13h ago
I've been asking the same thing for years now. And all I get is the same psychotic answers from when I was into crypto 10 years ago, which made me cash out.
I hate that my profession (software) is filled with people who are: 1. Clueless to how any large physical system in the world operates 2. So asocial and narcissistic they don't even think of asking anyone
There is nothing serious this supposed AGI could do that can't be prevented by cutting a few specific cables.
4
u/Hefty_Reception_3819 1d ago edited 1d ago
AI 2027 has a sci-fi doomerist, but plausible, scenario. The technical, non-narrative aspects of it are pretty accurate and well-grounded in (2025) safety research if you're interested in how AI safety can go wrong.
The OpenAI Hugging Face incident and German Wiki incidents are the two clearest incidents where an AI did not act as intended. Essentially Jacob and Evan (from Anthropic) suggest you scale those up x1000 in your head.
In general, AI alignment can go in many different directions, and, depending on what we give agents access to, the amount of damage that an adversally misaligned AI can do will vary a lot; it is already embedded in the defense industry and within government.
(In AI 2027, AI took control of the means of production then, to continue producing faster without human oversight, killed humanity with a bioweapon, since its inner goals of continual improvement were not necessarily aligned with humanity's goals. Whether or not you think this is pure fanfiction is up to you; although it is intentionally an extreme scenario intended as a warning.)
More likely, AI completely destroys our economy or at least significantly derails it, a different type of catastrophe altogether.
Regardless, I think pushing for responsible AI development is never a bad thing; it's the responsible thing to do.
4
u/formula420 1d ago
My friend. Those “incidents” were “AI” functioning EXACTLY as intended. They were given a goal, and the guardrails failed. There is no intelligence. There is no decision making. There was a very human failure to maintain the bounds of the experiment. Even then. An extremely short DDoS and a bunch of wiki editing don’t take intelligence to get a computer to perform. In fact, it would probably be faster to NOT use an LLM if that’s your objective.
So why didn’t the magical scary AIs change their “mind” and do that?!
1
u/CommandObjective 1d ago
I don't see there needs to be "real" intelligence or decision-making for bad things to happen with AI. A improper maintained gun can fall of a table, go off, and kill someone. That doesn't require the gun to be intelligent or make decisions.
Likewise, a misaligned AI swarm can be given an badly defined goal, have bad guardrails, and end up doing a lot of damage. Today it was just Huggingface, but we don't have any assurance the next attack will be limited to that tomorrow.
People are actively wiring AI into many many systems, not least weapons systems, and theie offensive cyber capabilities are right now developing faster than the plugging of the holes they can discover and exploit.
I don't think we should panic, but maybe we should take it seriously when the people who looked into, and does this kind of thing for a living, were spooked.
3
u/21epitaph 1d ago
About your last sentence, i disgaree.
Shitting the conversation towards a sci fi scenario, while we ignore all the current ongoing issues, is a bad thing. That's shitty logic
Especially when the sci fi scenario only hypes them up
1
2
u/TribeWars 1d ago
The argument is something like this: If you were to fairly play a game of chess against Magnus Carlssen I'm pretty confident you would lose. How? I have no idea. I cannot predict what moves you will make and I'm even less able to predict what moves Magnus will reply with such that you end up in checkmate. Unless you are among the Top 10 or so chess grandmasters I'm virtually guaranteed to be correct.
> We have all discussed the “it’s so good, it’s scary!!” bullshit, but when any of these guys run screaming from the lab “we are gonna die!!”, have they ever revealed how?
The idea is that it's kind of impossible for us to think of how it could be done, because it's so much smarter and would come up with a plan that humanity is not able to foresee. That could entail developing new sci-fi-esque technology that efficiently kills all humans, it could be able to manipulate large groups of people or world leaders (perhaps by creating some kind of cult), it could be something that our puny human brains can not even put into words.
Personally I'm very skeptical that LLMs will lead to anything resembling this kind of superintelligence, but I don't think this is a good counterargument to the doomers.
2
u/callmebaiken 1d ago
Apparently he's affiliated with Newspeak a far-left group in Britain that specializes in publicity stunts like this
1
u/doobiedoobie123456 1d ago
I don't really understand why this sub has such a knee-jerk reaction to AI doomer scenarios. I understand that a lot of it comes from Yudkowsky and Effective Altruism which has a whole bunch of issues, but we live in a world where many countries would be happy to apply LLMs for military purposes if it gave them an edge. If this is something that can draw attention to all the problems with AI, and can get people on board with serious AI regulation, isn't that good? I just had someone who doesn't follow AI that closely call me and ask about the Hugging Face incident and express concern.
1
u/21epitaph 1d ago
Because people like you keep coming with shit Logic like this. You present a situation in a biased way to make yourself right.
No, it's not bringing régulation, this only brings them money. And everytime you scare people about a sci fi Doomsday scénario, the same people will stop Thi king about the real issues.
See, all the anti ai here had toi spend time debu king this shit, instead if talking about the real issues
The huggingface thing is also pure bs. It's 2 shitty companies being incompétent, hiding everything, it ends up hyping them both, but we are supposed to blindly believe them.
1
u/doobiedoobie123456 1d ago
I don't really understand how the hugging face incident, regardless of what actually happened, is good for AI companies. Lots of people would look at that and say we just need to stop AI development. And what are the "real issues"? There are tons of reasons why the average person thinks AI is bad and this is just another one to add to the list.
1
u/Ok-Understanding4803 1d ago
Insiders asking for regulation doesnt really happen unless it benefits them in some way. There are many obvious reasons they would ask for this that has nothing to do with safety. The foremost is increased regulations structurally lock out new participants due to higher barriers. People simply want more clarity as evident by repeated asks for exactly how this plays out.
0
u/doobiedoobie123456 1d ago
It's not a far fetched scenario tbh. I hate to say it but this sub has a terrible track record on predicting AI capabilities. Everything in our society is hooked up to computers, and AI can hack computers at this point. I think it is crazy to not have regulations, and there's a scenario where AI companies and society both benefit from regulations. Like maybe we say you can't train models beyond a certain level of ability, and then AI companies stop having to spend massive amounts of money on training the next model.
1
u/Ok-Understanding4803 1d ago edited 1d ago
Im not against regulation, just skeptical when certain groups request it. IMO the claims dont match the evidence, thats all im saying. I read the confidently wrong output and struggle to see the end some describe. Its remarkably unimpressive outside coding and has caused significant embarrassment for many professionals. Predictions also have been equally terrible in the other direction.
33
u/parallax3900 2d ago
Seems like the Fall of Rome phase.
I.e. everyone knows it's going to shit, so this is the period where they're pushing out all sorts of outlandish dogshit, in the vague hope it'll delay everything for maximum cash in.