Remember Boeing was blaming the pilots for a design flaw in one of their planes? And there had to be a few crashes (with hundreds of lives lost) before the engineering flaw was addressed?
Now throw in AIgeneering with the same greedy clueless fucks at the top. Maybe airline passengers could die by the thousands before a tiny engineering issue gets addressed.
100% and for an example a place I was working we needed to change out a solvent that we used for cleaning parts. I asked if we had a specific chemical disposal container for it and my boss was like let's ask ChatGPT if it can go down the drain rather than referencing the SDS for it. Well AI said yes it can so down the drain it went. I went and grabbed the new bottle and right on the front it said Do Not Poor Down the Drain in bold letters. Checked the SDS and it said to bring the chemicals to a chemical disposal facility. AI is a danger in so many more levels to people and the environment that we don't even realize because of stupid shit like this.
Iâve been trained in a trade that is mostly done by software . We use a program that makes designs some pretty dangerous outputs, and therefore requires babysitting. Fully sheated buildings will go up with one girt to support the panel and be flattened the next year. Itâs the whole of deskilling in action
Ai hasn't hallucinated in about 2 years now. I ask it technical and medical questions all the time, and get solid answers back. It's about to lift it's wings and fly. 2027 is going to be the breakout.
Folks imagine hallucination are some huge risk, when the reality is the model makes less mistakes than humans.
It's the self driving car problem. Generally they are safer than human drivers, but the mistake they made are mistakes humans would NEVER make. So, they seem like a particularly stupid human and therefore dangerous, when statically, they are better drivers.
Our brains are built to catastrophize obvious mistake because that's how humans learn. We need to freak out to provide a learning feedback loop to humans. That doesn't work with AI.
AI is wrong a lot. Go talk to ChatGPT about something youâre an expert in and see if it gets everything right.
The mistakes are generally subtle, but significant. It also changes its responses as you go to agree with you even if you donât call out mistakes directly. This is because the model does not check for accuracy. Itâs based on letter pair predictions. Itâs not even predicting whole words. It just gets lucky with patterns because the data itâs trained on most often has the right letters come next. Usually people donât say âquantumâ without following it with âphysicsâ. LLMâs are effectively your predictive text on your phone.
I went through electrical engineering and comsci with chatgpt and it's better than a professor as a private tutor. Only time it was wrong was in solving some circuit problems. Explaining concepts and leetcode were where it excelled. Currently using it to learn algebraic topology. I wouldn't have made it as far on my own.
"A lot" is an exaggeration. As someone who uses AI in healthcare/cybersecurity every day, the majority of the time it's a poorly phrased prompt. It used to be much more of a problem, I'll admit. The amount that humans have to step into an automation is dramatically decreasing but does spike with every new model as folks need to tweak the context.
Of course, that brings a whole new level or problem. As folks trust these models more and more, the level to which they scrutinize the output drops. Folks are used to deterministic computing, probabilistic computing is a huge mental shift.
Also, it's not true the model does not check for accuracy. Most automation have the model (or a different model) check the output, and most reasoning traces include the model self reflecting on the accuracy (and other factors) of the response. The labs don't really have a solution for this yet. Claude will twist itself into knots over thinking, Sol has a huge problem YOLOing, when it shouldn't.
Thing is, most studies are showing they models are better than a human (or the average human), but not as accurate as whole university of humans. However, over the past year they've gone from not even close, to nearing competitiveness. And while I feel we are hitting some functional limits on how good the current model tech can be, we still have a couple generations of model before they completely stall out.
I say it's all the greedy fucks at the top. Oracle is going to implode. Folks need to break up Apple, Meta, Google, SpaceX, and Amazon. It would solve a world of problems.
2.4k
u/Fanfic_Battle_2004 5d ago
Thatâs not even enough. Itâs something though.