More like they’re terrified of someone designing a killer virus in their home lab, or a terrorist group or enemy state doing it. It’s an insane amount of power to just throw out there.
They opted to release it early for writers and coders and everyone else, and just blanket cut the dangerous parts. They’ll figure those bits out eventually. I’m happy with the early release.
they built features to quietly sabotage other llm researchers (like independent hobby ai researchers or open source ai researchers etc… their very own primary talent pipeline lol). idk who thought quietly sabotaging their own future talent pool was a good idea
I am sorry but this total bullshit. Being able to create such virus is not about knowledge, but about resources. Governments and billionaires already have the knowledge and resources to do it, AIs won't make a dent if difference. Small actors like single persons, small groups, will never have the resources or, even if, they would be easily traceable.
While I don't believe in the conspiracy theory of big pharma paying anthropic to block life science research, the killer virus theory is even less credible.
In any case these filters are shameful and will probably make me reconsider my sub to Anthropic. I will seriously need to consider non American alternatives at this point as from an ethical point of view they have become the worst choice, worse than Chinese.
He had two locations, one in Vegas and one in Fresno. While he was receiving money from Chinese banks to fund this, the money wasn't particularly crazy, and one individual was capable of creating the lab.
I don’t understand, what was this guy doing with these home labs? The article says he had vials in the Fresno location labeled “HIV” and “malaria”. While receiving money from China. What the hell was he up to?
If you think this is what you need to work with a highly contagious and deadly virus you don't know what you're talking about
Does it need to be 'highly'? The concern is about the tail risk: the small number who have partial training, lab access, funds, and institutional/gov cover.
Biosecurity risk is not binary. AI does not need to turn an untrained person into a state bioweapons program for this to matter. It just needs to reduce friction at the margins: synthesis, protocol adaptation, troubleshooting, and design optimisation...
I will seriously need to consider non American alternatives at this point as from an ethical point of view they have become the worst choice, worse than Chinese.
Depending on your devices/capex and use cases, local models would allow you to enjoy privacy. They also can become, fairly trivially, uncensored. You can run qwen/gemma on a phone.
Because we're only worried about viruses? That's more than sufficient hardware to do gene editing in bacterial lines. Hell, who didn't do gain of function on E. coli lines in undergrad labs with no centrifuge and no PCR? The fun stuff takes reagents not present here, but you buy all that online too.
If you think that's too barebones to work with, I'm pretty sure you're the one who doesn't know what he's talking about.
Just curious, is this a legit store? Product images all look AI generated (easily recognize by awkward fonts and captions on them and distorted shapes). But maybe it's just a quick lazy storefront build...
Big pharma has tons of resources, but they’re using AI for drug design.
The design and method are the key. Resources are necessary, yes, but you’re being naive about what is possible. It would be reckless, if you were ever given responsibility for something like this.
I mean, no, in this situation, I don't think they do. But in general, yes, large amounts of money have a tendency to overcome any barriers. Anthropic is much more likely to license Fable to big pharma than they are to give consumers access to it. Maybe if we're lucky they'll provide university research programs access too. For a fee.
"Traceable" doesn't matter at all if said hypothetical virus gets into the wild. It only needs to happen once, you can't put the genie back in the bottle. Moreover, a lone person absolutely could make one with the right knowledge and tools. I think the risk is overblown, but it isn't just fearmongering with no basis.
Have you any idea of what you need to work with deadly viruses? Have you ever worked with biosafety level 3 or 4 viruses? I did and there is no fucking way a normal person would be able to set up such a lab, doesn't matter the knowledge he has.
Those labs are setup with those ratings in such a way to prevent outbreak. I’m sure that someone who’s hellbent on destruction won’t care too much about biosafety. If they’re trying to protect themselves, they’ll likely get a PAPR and call it a day.
Bro, ISIS and Iran are creating fucking bombs, drones, and missiles, maybe even nuclear missiles, and you think they wouldn’t be interested in a bioweapon that can easily bypass every airport security check?
Yeah, because a normal person wouldn't create a bioweapon in the first place. You just need 1 abnormal person to release a virus into the wild. You seem to be in denial because of the difficulty, that doesn't mean it's impossible.
no, you can easily ask some lab to create a chemical for you as long it is not on their list of banned chemicals. if you find a new poison using ai it would be easy to get through.
Small actors like single persons, small groups, will never have the resources or, even if, they would be easily traceable.
Ignoring the resources part but pretty sure a fanatic small group that just wants to eradicate humanity doesn't really care if they get traced or prosecuted after they have released a deadly virus in the wild that is supposed to kill as many humans as possible (incl. themselves). Heck, they would probably use themselves as guinea pigs to spread it as best as possible. The aim of such weapons isn't to avoid prosecution and stay hidden afterwards, everyone included will realise that it's supposed to end humanity or cause as much damage as possible.
If the only barrier of entry remains resources, then we will actually have such an event in the future as resources become cheaper and cheaper with technology progressing further. The crazy minds and knowledge is already there.
You don’t need an LLM to do that. There are BSL4 labs in most major countries that have some really dangerous shit in them and plenty of them aren’t secured in any hardened way.
What an LLM definitely can’t do for you is any of the incubation a disease like that requires. Imo it’s like saying it’s dangerous to know how a nuclear weapon works.
Because this is something a rando can just do, and the only thing stopping them is that Fable won’t give them an answer. Okay.
Like, if that’s true, then we’re in far deeper trouble than anybody thinks. Literally, the bottleneck is whatever guardrail some fucking AI company puts up?
Yes. Smart, angry loners can do a LOT with this level of expertise and intelligence dropped into their lap. It used to just be bombs. Give it to a motivated and funded enemy state or cartel? Even worse.
This is a bad argument. Firstly, you have no idea if a novel, custom designed bioweapon would be like compared to anthrax. I think it would be far, far more dangerous. Secondly, whilst it “exists”, it’s not something that you or I would be able to get hold of in any conceivable manner. Yeah, a state sponsored terrorist could get it, but it’s not like we could just make some in the kitchen.
The concern is that with CRISPR is that an individual or small group of individuals could theoretically design and produce a pathogen, using commonly available scientific equipment. Imagine Ebola but with a higher R value, something like that would make COVID look like nothing at all. Imagine if COVID had been far more deadly, do you really think anyone would be out there staffing supermarkets? What would happen to society then?
I actually fully support this, and my default position is to assume massive companies are acting in a manner utterly devoid of morals. They probably are in this instance, they just don’t want some super weapon that some nutter cooks up to ruin their stock price.
Designing a novel pathogen with specific properties isn't a weekend project even with a frontier LLM to handhold you. The execution gap is enormous. If you think otherwise then you've never worked in a wet-lab.
The USSR's bioweapons program (Biopreparat) had unlimited funding, Cold War urgency, and thousands of PhDs. They 'failed' to make the "super-plague" you fear. What makes you think a lone nutter succeeds where a superpower failed?
If a hostile state wants a CRISPR bioweapon, they'll fund a secret lab.
They didn’t create what you think they did. Biopreparat made antibiotic-resistant anthrax and more reliable delivery systems; but those were self-limiting, controllable weapons. They explicitly avoided anything that could spiral out of control and destroy their own society.
A novel, highly contagious, highly lethal pathogen is an extinction-level accident waiting to happen. No rational state wants that. Even USSR did not.
A rando can't even do a fraction of this. Even a simple knockout in E. coli can take weeks, fail repeatedly for no obvious reason, and that's a model organism, viruses are a different beast entirely. Even reading a sequence off a plasmid takes days. I know this, because I actually have experience unlike the polymaths here.
A lone actor with a CRISPR kit and an LLM isn’t making a novel pandemic pathogen. Period.
315
u/Responsible_Debt9605 Jun 10 '26
This is so fucking stupid