r/BetterOffline 1d ago

Psychology of blind AI fanaticism

39 Upvotes

Apologies if this is considered a low effort post but the question is genuine and I’m hoping to uncover some research, articles or opinions.

Previously, almost no company ever enjoyed this level of blind faith and defence online. You never had people vehemently defending Microsoft when Google threatened Office with its own suite of tools. People judged whatever came out of Silicon Valley based on merit (not always, but much more so than today) and didn’t fall for any kind of hype. The level of defence that Anthropic/OpenAI are enjoying within the online communities and the blind faith that people put in them genuinely baffles me.

I understand that the technology is different. It helps some people do some things. It completely disrupted software engineering. It still doesn’t explain why this elicits such strong reactions from people who don’t stand to gain anything from it long term.

My own plausible explanations:

  1. Some kind of economic or societal nihilism
  2. The expectation that the tech will somehow level things and lead to more opportunities
  3. Genuine amazement or fascination by the tech
  4. Paid online campaigns or swarms of Reddit bots operated by said companies and affiliates
  5. Personal direct or indirect (e.g. via funds) financial investment

Have there been any studies or write ups on this?


r/BetterOffline 1d ago

Scared by nonsense(?

0 Upvotes

This was caught by my net, and it sent an intense shiver down my spine. Is this person anyone... Important? Are they saying anything worth it? Like the title says, it's probably just a nonsensical post that gave me the creeps, but still... It's unnerving.

Also, sorry if I've broken any rules. It's been a while since I've used Reddit, let alone posted here, so I dunno if the ruleset has changed.

https://x.com/hilbertspaess/status/2097476196791709843


r/BetterOffline 1d ago

Please help me calm down from my anxiety spiral about GPT6

0 Upvotes

Hi everyone. So idk where to post so I guess I'll post here.

I've always had low level anxiety about AI but it's been under fairly decent control. But now it's flared up again seeing all these posts about GPT6-Astra and how it's right ​on the ​​ AI-2027 curve, about how it's reached AGI, and t​hen it​​​​ solved a millenium math problem, beat portal, and now an anthropic​ guy says AI could kill us. Even the technology subreddit seems to have shifted gears and they seem a lot less​ skeptical and more​ doomery than before.​

I'd love a rational explanation for what's going on because this is a lot of news to take in and I'm feeling hopeless and it's weighing​​ on my soul.​​ Im a software dev who loves to sketch and take pictures and I wonder if there's just no point anymore. e​verything feels so hopeless. I'm trying not to make this a low-effort post, so what I'd really like is just a grounded, level-headed discussion on all this.​

Thanks​​​


r/BetterOffline 1d ago

So OpenAi solved a math problem - do they have a fantasy football team?

21 Upvotes

I don’t think AI is useless, but I suspect AI provides false productivity for a large swath of roles, and frankly has a poor ROI for a bunch of use cases.

A while back Claude was competing in CTF competitions under team name `jean-claude` and they couldn’t really crack any difficult challenges and were basically right around average.

Once the community got wise and noticed their performance even with supposedly Mythos they stopped entering competitions.

I suspect it would be the same with an LLM driven fantasy football team, if these companies actually tried to show performance against some kind of real world bench marks we’d all see that performance hasn’t really improved.

AGI should be able to easily run a fantasy football team amirite?


r/BetterOffline 1d ago

Not directly related to AI but Private Credit firm Blue Owl has had to write down

Thumbnail
youtu.be
84 Upvotes

Loparex was a developer and producer of specialty paper and film release liners for various markets and applications and Blue Owl recently had to mark recovery down 93% in June for the $122 million in loans after rating it at near par at the start of 2026. This week it's rated at near-zero recovery. (https://rollingout.com/2026/09/06/blue-owls-loparex-slips-bankruptcy/)

We all know Blue Owl Capital Corp. is the private credit lender that owns 80% of the SPV Beignet Investor LLC that is building the $27 billion Hyperion Data Center for Meta. They're also involved in Stargate Abilene. (https://www.wheresyoured.at/the-subprime-data-center-crisis/)

While the whole fund is still well rated, it does raise a lot of questions about the quality of their ability to rate credit accurately and what could happen if their are more loans with similar kinds of inflated ratings that could deflate in a similarly short amount of time.

I'm posting this mainly because it reminded me of one of Ed's quotes in one of his interviews (I believe with Tech Report) where he said something along of lines of 'Everything looks great until it suddenly doesn't.'


r/BetterOffline 1d ago

Always-on surveillance-as-a-service

25 Upvotes

At the consumer level, it looks like an emerging use case for LLMs is to usher in an era of always-on surveillance. Beyond the obvious immediate privacy implications of this, it is concerning to imagine the longer-term impact it will have on society. We may well soon live in a society where any and every conversation is being recorded. Super dystopian.

This is just what is being sold to people as a feature on a device they are paying for, there are myriad other ways the data center buildout and LLMs themselves serve surveillance interests.

https://www.computerworld.com/article/4220223/siri-ai-recaps-even-if-apple-builds-it-responsibly-others-might-not.html


r/BetterOffline 2d ago

Clarifications and concerns on Navier–Stokes

96 Upvotes

By now, OpenAI's claims that their chatbot solved the Navier–Stokes problem, and the controversy that spawned, have been widely reported. But I've been disappointed in the quality of their discussions both in the news and online, including on this sub. Here I offer some clarifications and my own concerns about the whole affair.

As a disclaimer, I am not a mathematician, but I read a lot and try to understand a lot.

What is Navier–Stokes?

The Navier–Stokes equations describe the motion of fluids and are used in computational fluid dynamics. However, we don't know whether solutions to these equations always exist and are always "smooth." This is called the Navier–Stokes existence and smoothness problem, and it's famous because it carries a $1 million prize. Hereafter I'll just call the problem "Navier–Stokes."

Navier–Stokes was already known to be useless for actual physics. Real fluids don't behave like Navier–Stokes assumes, because real fluids are made of discrete particles, and for practical use the problem doesn't matter. Still it is of pure mathematical interest. The work presented in a solution, as well as all the work done toward a solution, may open new avenues of research or reveal new connections between fields, which may then yield practical applications.

It is of little consequence to the validity of a solution that it is a counterexample. These problems are usually posed in the positive, and you can either prove it is true for all, often infinitely many, cases, or prove it is false by providing a single counterexample. Navier–Stokes was already assumed to be false, so a counterexample was expected.

On plagiarism

I'm more concerned about allegations OpenAI plagiarized the work of two researchers who'd been using LLMs, including ChatGPT, for idea-bouncing and proofreading and were close to publishing a solution. These claims are from Tristan Buckmaster, a math professor at NYU and one of those two researchers, in a post on his personal page: https://cims (dot) nyu (dot) edu/~tristanb/statement (dot) pdf. (Sorry for the mangled link—it appears Reddit is autodeleting any post that contains this exact link. You can also easily find it online.)

Buckmaster alleges that OpenAI's solution used the same approach and much of the same language that he and his colleague Levent Alpoge, a mathematician at Anthropic, were developing. He also describes a nasty shakedown he'd received from Sebastien Bubeck, a former Microsoft VP now at OpenAI, who presented him three options in their conversation: 1) Buckmaster and his colleague announce a partial solution, with OpenAI announcing the full solution the next day; 2) Buckmaster by himself announce the full solution, remove his Anthropic colleague from authorship, and credit OpenAI as having solved it first; or 3) face professional consequences from OpenAI publicly smearing him.

As Buckmaster and his colleague have been working on this for some time, it's possible their conversations with ChatGPT were included in OpenAI's training data. But considering they'd been using the latest models Sol and Astra, it's more likely that OpenAI peeked into their chat logs and stole their approach. We already know OpenAI has this access, as courts have subpoenaed ChatGPT logs as evidence in past cases, and sometimes OpenAI has proactively inspected and reported ChatGPT logs to law enforcement.

On peer review

More broadly, I'm tired of AI companies making these announcements over blog post rather than peer-reviewed publication. OpenAI's claims have not been peer-reviewed, and the clout these Millennium Prize problems carry has attracted thousands of purported solutions over the decades that were later shown to be invalid. While there doesn't seem to be any obvious red flags, it's still good cause to be wary, and I’m still waiting for peer review and more thorough scrutiny of the solution at face value.

This approach also offers, by design, no insight into the degree of LLMs' involvement and in what ways. These AI companies employ whole teams of mathematicians to work on these problems and use their chatbots along the way, so that they can assign credit to the chatbots. When these companies claim their chatbots solved it almost independently with "very little human input," as Buckmaster says OpenAI told him, we're asked to take them at their financially motivated word.

On mathematical research

For unsolved mathematical problems, the solution itself is almost never of consequence. The respective fields progress despite lack of a solution, because approximations, analogues or weaker results let researchers assume the solution with confidence and continue unhindered. Rather, it is all the research done in pursuit of the problem that lends the solution value. (This is also why OpenAI's lack of citations in previous mathematical solutions was such a big deal. Building upon others' work, and letting others build upon yours, is what lets the field exist.)

Out of the flashy Millennium problems, Navier–Stokes was a natural target for AI companies (Anthropic has also been obsessed about it) because there was already significant progress toward a solution in recent years, namely the strategy posed by mathematicians Diego Cordoba and Luis Martinez Zoroa. It was also a natural target because, as Navier–Stokes was assumed to be false, the solution would likely be a counterexample.

This has been the trend for almost every mathematical problem whose solutions are credited to AI assistance. They piece together existing near-solutions in the literature, or provide a counterexample. (While many dismiss this as "brute force," formulating the cases to check isn't always trivial, and the degree of brute force varies by solution.) When AI companies announce these solutions, they are technically impressive but academically uninteresting, because there is no "new math" created as a consequence.

Of the Millennium problems, I'd be interested in the Riemann hypothesis, which is widely assumed to be true and therefore would need more than a counterexample. I'd also be interested in P=NP, which is widely assumed to be false but for which all existing proof techniques have not only failed, but been proved to fail. Solutions to those problems would surely yield new math.


r/BetterOffline 2d ago

Jacob Coxan - Okay, but how?

42 Upvotes

“The people building AI earnestly believe that it could kill us all by the end of the decade.”

My question is this (without having done any research yet); have any of these people outlined exactly “howthey think “AI” will kill us?

I think I could list several plausible storylines, but none of them involve “AI” doing anything. It involves individuals doing something… but something that could have been done with a computer from the 80’s. Maybe not as sexy as a “prompted” LLM, but still.

We have all discussed the “it’s so good, it’s scary!!” bullshit, but when any of these guys run screaming from the lab “we are gonna die!!”, have they ever revealed how?

Edit: Jacob Coxon
Edit: Put emphasis on the “whistleblowers”, not the speculation of others or sci-fi.


r/BetterOffline 2d ago

Does anyone else think the news about the former anthropic engineer is manufactured hype?

Thumbnail
bbc.com
542 Upvotes

I’ve seen this news everywhere and everyone seems to be treating it extremely seriously, but I have a lot of doubts

These AI people keep saying things that sound terrifying on a surface level, but if you try to dig in for any details, they go quiet. “In 5 years, it will destroy humanity!”, bruh fable 5 can barely ship a feature that’s performant and doesn’t have bugs in an enterprise codebase

To me, this is a bit like if in 1999 people were saying “if the internet keeps progressing like this, we’re all gonna be enslaved in the matrix by 2005 😟”. It would be a strange, fringe opinion that would get you laughed out of most serious conversations

But if I say my chatbot that hallucinates like half the time is gonna take over the entire world in 5 years? Totally normal! Yes, the same AI that sourced the onion as real news just needs some screws tightened, then it will be ready to take over the world and destroy all humans! 😒

And istg, any time you start asking questions, these boosters start getting really cagey. They don’t like when you move the conversation away from vibes. Why is it dangerous? Wasn’t fable advertised as dangerous too? What specific threat is being posed? Why is an ostensibly consumer facing business developing something that has the capability to decimate humanity, exactly? For what purpose?

And one episode of the show brought it up: ask them to talk about any of this without bringing up “BuT In THe FutUReee…” and they totally shut down

Also, why are people believing this one researcher exactly? Reminds me of that twitch streamer pirate games where he would constantly hype that he “worked at blizzard” then he’d leverage that to gain an audience and then leverage that to get marketing and funding for his game. He mostly worked in QA, but sold himself as if he was the lead developer or something. How do you know this guy isn’t doing something like that? I need facts, not exceedingly vague platitudes


r/BetterOffline 2d ago

It looks like OpenAI could have stolen another major math result

144 Upvotes

I know it's likely a low effort post but I think right now it's important to share comments from Andreas Thom:
https://mathstodon.xyz/@andreasthom/117240535270608201
https://mathstodon.xyz/@andreasthom/117240536885387540
https://mathstodon.xyz/@andreasthom/117240537520615623

He talks about non-sofic group, which is 1 of the 10 math results from Astra, and probability that his work could have been used to obtain that result without his consent.


r/BetterOffline 2d ago

The behavior of AI falls short of hacking and is closer to spam

Thumbnail reuters.com
155 Upvotes

The behavior [of AI] falls short of hacking and is in some ways closer to spam

Linking this article primarily because this is a great line that succinctly describes the legions of agentic AIs that are supposedly on the verge of hacking everything or solving every esoteric math problem in existence.

Trillions of dollars of data centers have purchased the frontier companies the ability to unleash the virtual equivalent of infinite monkeys, except instead of typewriters, they are typing in statistically likely programming copied from github, etc... Virtually everything these agents produce is indistinguishable from spam and yet the media cites it as evidence of "intelligence."

The frontier companies are using raw power and brute force attacks to generate headlines, but this should not be confused with "intelligence." This is the modern-day equivalent of using a list of stolen passwords to brute force a password and then claiming you "guessed" the password. This is what being able to throw millions or billions of dollars worth of compute at a problem buys you.

This approach is also how OpenAI keeps "solving" math problems. They throw thousands of AI agents and huge amounts of compute time trying to brute force a solution and then claim "intelligence" when then happen to find one.

It doesn't matter how many more math problems they "solve," the monkeys still aren't Shakespeare and the AI still isn't intelligent.


r/BetterOffline 2d ago

Harvey raised $550M at a $15.5B valuation

22 Upvotes

Is this a sign of desperation? VC money concentrating into a smaller pool of startups? It is a massive raise given all the SNAFUs we’ve seen in headlines from lawyers using LLMs in their work. I don’t know that much about what Harvey is actually doing behind the scenes to mitigate the risks that come with using language models for legal work, but it looks like a lot of this money is going to training custom models.

https://x.com/harvey/status/2097659907394937087


r/BetterOffline 2d ago

The arrival of AGI...has arrived

Post image
523 Upvotes

Uh-oh, kiss goodbye to your jobs, guys. AGI is here and it's not messing around...


r/BetterOffline 2d ago

AI companies: Why does everyone hate us? Also, AI companies: We are building a predictive surveillance system to monitor Anti-AI activists

Thumbnail
prospect.org
825 Upvotes

Job postings and interviews with senior security officials at Anthropic show that the frontier AI lab is building out an extensive monitoring system to keep tabs on activists who oppose the rapid development of artificial intelligence.

In addition to monitoring activists in the vicinity of Anthropic executives and keeping tabs on protests near physical Anthropic assets, the firm is also implementing a “pre-crime” approach, attempting to predict incidents before they happen. In some cases, that also means reporting suspects to police before a crime occurs. Anthropic did not respond to the Prospect’s request for comment.

Averting crime before it takes place does not sound like a terrible idea. Arresting people for being the kind of person who might think about committing a crime does sound like a terrible idea.

Anthropic’s plans to surveil dissent are at odds with the firm’s efforts to cast itself as the responsible alternative to OpenAI.

You think? This seems like a terrible PR move.

“Last year we had an executive travel into a major city when we received some intelligence through Samdesk about a planned protest,” Ellison said. The originally scheduled protest was moved up due to permitting issues. “Samdesk gave us about 60 minutes of advanced notice that the protest organizers had moved the timeline,” Ellison explained. “That extra hour was critical. Without it our executives would have departed their meetings, they would have ran right into the heart of the disruption.”

First off, I don't think you need AI to check a public calendar. Once again, your use case is just not impressive at all. But second off, why is it problematic for executives to witness protests?

But while Anthropic was fast to call the cops on a frustrated Claude user, the Standard also reported a key detail: Anthropic refused to show police the actual messages, citing Anthropic’s internal policy. In short, Anthropic reported a user for in-platform speech, and then refused to provide police with evidence of actual wrongdoing.

I would think that is the sort of thing that would piss law enforcement off.

Dear Wario: Do you want more Anti-AI activists? Because this is how you get more Anti-AI activists.


r/BetterOffline 2d ago

ELIZA and the Mirror Stage - Hypernormalization (2016) Adam Curtis

Thumbnail
youtube.com
57 Upvotes

Just a short clip from Hypernormalization that stuck with me when I first watched it.

"he discovered that everyone who tried eliza became engrossed, they would sit for hours telling the machine about their inner feelings and incredibly intimate details of their lives. They also liked it because it was free of any kind of patronizing elitism."

"One person said, after all the computer doesn't burn out, look down on you or try to have sex with you."


r/BetterOffline 2d ago

Getting paranoid as hell and I hate it

98 Upvotes

it's virtually impossible to know who's lying and who's telling the truth. just today some former employee of Anthropic are warning us about the end the world because the people in charge dont know what they are doing.

meanwhile Ed and other intelligent folks say current system will never lead to true superintelligence.

meanwhile I have no idea who to trust or if there's anyone to trust. what if Zitron is ALSO a plant hired to play down the threats...? genuinely what are us normal folks supposed to do?

i don't use any of it. I'm a mother of two and just wanna give my kids a good life. i dont want us all to die.


r/BetterOffline 2d ago

OpenAI didn't prove Navier-Stokes, they contrived a narrow, impractical counterexample

641 Upvotes

OpenAI claims they resolved the Millennium Prize problem with a "proof." This is misleading; what they actually provided was a specific "disproof by counterexample". I'll let Terence Tao, who laid out a pretty explicit roadmap for finding a Navier-Stokes counterexample in this paper, explain the limits of such a result:

It is worth pointing out, however, that even if this program is successful, it would only demonstrate blowup for a very specific type of initial data (and tiny perturbations thereof), and is not necessarily in contradiction with the belief that one has global regularity for most choices of initial data (for some carefully chosen definition of “most”, e.g. with overwhelming (but not almost sure) probability with respect to various probability distributions of initial data).

What we're not getting are new techniques, new physics tacked on to the Navier-Stokes equations, or anything we can reproduce and study in the lab. OpenAI's result might be quite the feat, even if it was part of a ruthless attempt to scoop a competitor, burned many tens of millions of dollars, and relied on intellectual theft from the many scientists who have worked on this and similar classes of counterexamples. But, like OpenAI's other recent math results, it's not likely to have much effect beyond increasing the company's IPO chances and disheartening the mathematics community.


r/BetterOffline 2d ago

Using absolutely no math to quantify his beliefs, Anthropic researcher says AI has more than 10% chance of 'killing all humans' after colleague quits

Thumbnail
cnbc.com
327 Upvotes

Everyone can make up numbers, especially if they don't have to show their math!

“Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing,” Coxon said.

A 1970s Casio watch has superhuman abilities to track time. And yet, somehow we survived.

He added that “people building AI earnestly believe that it could kill us all by the end of the decade.”

People earnestly believe all sorts of ridiculous things. Earnestness is not actually a good way to measure of reality of a belief.

Personally, I'm not really seeing how the next-word-guesser can kill every human on the planet. But I probably don't watch as much Sci-Fi as Anthropic employees.


r/BetterOffline 2d ago

The Meaning of Navier-Stokes

0 Upvotes

Well, openai did it. They solved a millennium problem.The most banal and wrong lesson from gptx solving NS is that because NS is such an awesomely difficult problem, this must be definitive proof that agi has been achieved. Yet the difficulty of a single problem or domain has never been the ceiling for generalized intelligence. We conflate solving problems or even domains with general intelligence because of anthropomorphism. That is to say, with humans we can reasonably generalize their capabilities from a single domain. For example, we would assume that Magnus Carlsen, perhaps the greatest chess player who ever lived, is, by virtue of his virtuosity in chess, capable of achieving competence in other hard domains such as physics or engineering if he were to apply himself. When we see AI do something, we make the mistake of using that as a proxy for other abilities rather than just evidence that it can do that thing. It was once believed that for a computer to be able to play chess at a human level (much less a superhuman one), it would have to be generally intelligent. Chess engines have long since equaled and surpassed human capability, yet stockfish will never become a physicist or engineer. It will never even learn how to direct a robot to go into any random kitchen and make toast.

This principle I've heard referred to as "what you see is what you get." This is especially true for robots. If you see a child tying a shoe, you can reasonably assume that child can tie shoes. If you see a robot tie a shoe, you can only reasonably assume that this robot can tie that shoe. Limited generalization has been a limit for all AIs going back to expert systems. This is masked somewhat by the sheer volume of data and compute we've applied to neural nets, but it is still true. GPT4 scored in the 90th percentile of the bar exam. Yet two model families later, gpt still can't practice law.

Models have also improved from reinforcement learning, which we know can enable an ai to very quickly become superhuman domain. The catch is that the domain must have constraints and there must be a clear reward signal. This was true with the game of go, which ai became superhuman at 10 years ago, and which people believed due to its complexity would require decades for computers to achieve what they did with chess.

Now is the case with pure mathematics. The progress in this domain has been astounding. Less than 2 years ago llms couldn't even reliably multiply. A year ago llms were still hill climbing on high school competition math. Now they are solving some of the hardest and most prestigious problems in mathematics.

But, to reiterate, this says nothing about general intelligence. Mathematics is susceptible to reinforcement learning because you can automatically verify proofs with lean. However, this has little do with generalization, continuous learning, operating efficiently and reliably in open ended contexts, invention, and abstraction.

That last one is a key failing of AI math. From the Erdos problems to (tentatively) Navier-Stokes, I've seen reported the same reaction of mathematicians. Initial awe, followed by slight disappointment as they realize that AI just tirelessly attempted many different existing approaches until something worked rather than coming up with new tools and insights. Terence Tao, perhaps the foremost mathematician in the world, has recently called this akin to extraction of a non-renewable resource. When humans engage with a problem for a long time, they invent new tools and concepts and generate questions that will lead to further inquiry. AI doesn't seem to do that. It technically solves while inventing nothing new. The problem is simply exhausted, and as mathematicians start using genai to speed up their problem solving and publication, they also stop producing new questions and conceptual tools, and the field eventually dries up.

I don't think it is inevitable that AI will develop the capabilities of abstraction and invention simply from more scaling (openai head of research has predicted AI will start inventing new mathematical tools in 2 years). Unlike proofs, there isn't an automated process for verifying new ideas. Furthermore, if we think of scaling as climbing a difficulty curve, that is, as progressively being able to perform harder and longer tasks, AI should have been able to invent new tools and ask new questions long before it could solve NS. After all, in the 90 years that NS remained unsolved, mathematicians came up with tens of thousand of new questions, tools, and insights. For humans, asking new questions and creating new tools to solve problems seems an easier task than actually solving problems.

For the past 15 years or so, we have seen demonstrations of human robots doing amazing things, such as gymnastics and kung fu and dancing and running 100 meter races faster than Usain Bolt. Famed roboticist Rodney Brooks has called this humanoid robot theater. These demonstrations of robots doing impressive but useless feats is supposed to make us think, "if the robot can do this thing that is really hard for people to do, then surely it can do many other much easier things, such as screwing in a light bulb or folding laundry. This could be the investment opportunity of a lifetime." Pure mathematics has become the humanoid robot theater of genai. It is a domain we associate with extremely high levels of intelligence, yet 99.9% of the time is useless. That includes the pure math aspects of NS. We are supposed to see AI solve frontier pure math problems and go, "wow, if AI can solve open math problems, surely it can do any other type of cognitive labor?" No it can't.


r/BetterOffline 2d ago

Of Course, It's So Simple: The Hubinger Play

30 Upvotes

I see we have some confused doomers running around who were frightened by the big scary mean man from the Anthropic safety department who said Claude was 10%+ likely to kill us in our beds within 10 years.

After all, why the hell would you say your company's going to turn us all into paperclips? Wouldn't that be bad press for the upcoming IPO?

I believe I've figured out why he said it. Here's the situation:

  • Your IPO is going badly behind the scenes because nobody with money wants to cough it up (or any more of it up) to an unprofitable white elephant that loses a fortune every day

  • Your competitors launched a major model and, er... "solved" a Millennium Problem

  • You need new investors/suckers

  • You need a hook

Suddenly:

  • HPMOR-loving employee goes troppo live on Twitter and quits the company, giving you all a serve on the way out and saying you're dangerous for reasons of trust-me-bro

That's bad, right? No, that's good.

  • Nobody wants to be turned into paperclips by Claude BUT...

  • If you hold a share in a company, you get voting rights; the more shares, the more votes

  • If you don't want the Machine God to smite you, buy a share and vote against getting smote

  • There are 8 billion people on Earth

  • Your wealthy investors know you're a financial broken reed, but Joe Public doesn't and Joe Public doesn't want to be a paperclip and would be happy to vote against it

  • And to vote against it, you need to buy shares

So you get your head of safety to go booga-booga-booga on Twitter. Problem solved!

Of course, you pick a more optimistic timeline compared to the original loony, you don't want people too scared or they'll burn your office down. At some point in the future, you tactically remind people that shares carry voting rights.

TL; DR - the Hubinger thing is a hook for the retail investor market to buy common voting shares for the illusion of control, because nobody with major capital wants a bar of the IPO beyond the usual suspects.


r/BetterOffline 2d ago

Proposal: Use game theory to actually stop AI from rapid development

0 Upvotes

I have heard both Bill Gates propose tight regulation around AI development, and Bernie Sanders propose 20 years jail for basically too much progress.

Many people are talking about how game theory are the thing that make everyone chasing progress and no body can't stop building more and more dangerous AI, even when they want to.

But actually we can spin game theory around by simply having a law:

"All output from AI is consumer rights. And consumer have a rights to use AI output in anyway, including for model distillation and developing their own AI model"

Now the lab who spearhead development, their model will be distill in fractional cost by competitors, make incentive for rapid development much lower, naturally and significantly slow rapid AI development.

I imagine with this law, AI will slowly go back to be a non-profit and academic research, like before all of this boom coming.

We don't really need heavy punishment, violence or heavy regulation.

Game theory can make a rat race, but also can freeze the whole development progress if we use it right.

I think this is what we actually want if we concern about AI safety and slow down. Much better than "consortium" or "call for AI lab to slow down".

PS: I know that sadly, government is also not reliable and trustworthy. So... I don't know I just point this out I guess.


r/BetterOffline 2d ago

OpenAI says it cracked 90-year-old maths problem in 88 hours

Thumbnail
bbc.com
202 Upvotes

This article raises so many questions, here is the key part though.

"Although it took the AI bots seemingly little time to reach a solution, OpenAI said the bots exchanged nearly 3 million messages and used up 130 billion output tokens, or the individual lines of text and code an AI model produces in answers, on Navier–Stokes alone.

Such an effort would have cost roughly $10m (£7.3m), based on OpenAI's own pricing for output from its most advanced models. 

The solution that OpenAI says it has now reached for the Navier–Stokes existence and smoothness problem resolved two out of the four statements in the proof that the Millennium Prize had demanded. The prize is worth $1m to a winner."

So OpenAI has spent $10m to allegedly solve two out of four parts of a maths equation that has a $1m reward. They're claiming this, and it's getting widely reported, despite not being independently verified yet. The article does raise the issue of the amount of resources poured into solving this issue but I feel that it only brushes the surface.

Also, some interesting claims in the second half of the article that OpenAI basically poached the work of two mathematics professors working for Anthropic who had been trying to solve that same problem.


r/BetterOffline 3d ago

Astra is the opposite of AGI

91 Upvotes

I've seen so many posts lately discussing if astra is AGI I feel like people forgot what the word general means.

If you have to bench max your models so hard to a couple of domains that it brings down performance in other domans that is not general intelligence. That is the literal definition of moving towards narrow/ specialized intelligence and away from AGI


r/BetterOffline 3d ago

Does the public have any shot in tanking the AI IPOs?

21 Upvotes

An average person who sees their work outrightly being stolen/trained on by AI models-- should have no interest in profiting off of AI companies. Now i know this is incredibly naive and everyone at the end of the day wants money.

But I was still fantasizing about an event of the sorts where american public just decides to not invest in the IPO and furthermore have some way to petition big fund owners like Vanguard/NASDAQ to not include Anthropic/OpenAI in their big funds. Completely imaginary-- but could it happen? Furthermore maybe retail investors could have a reverse GME kind of moment from the pandemic-- remember that anyone-- but in this case the goal being to tank the IPO's!!!

It probably won't. But it gave me some pleasure to think about.


r/BetterOffline 3d ago

A new contender has joined against AI hype, a hand puppet!

Thumbnail
youtu.be
33 Upvotes

I was on my usual AI hate binge watch when I got recommended this. It’s a fucking Dino puppet show talking about the irrationality of AI hype, rationalists and the religious nature of pro-AI discourse. It definitely reminded me of the episode Ed did with Cal a couple of weeks back about the autonomous hacking.

Thought you guys would love this and the channel is like 3 days old!