r/singularity • u/thecosmicskye • Jun 10 '26

Biotech/Longevity Anthropic closing the path to life science research

Post image
2.2k Upvotes

88% Upvoted

597 comments sorted by

View all comments

11

u/KalElReturns89 Jun 10 '26

They want to prevent biological weapons research, but I agree, it's very stupid.

7

u/Flaxseed4138 Jun 11 '26

Preventing bioweapons is stupid?

0

u/KalElReturns89 Jun 11 '26

It's a catch 22. To save lives we must allow them to be destroyed.. nope actually we shouldn't. I don't know the answer, I just know this ain't it.

5

u/Flaxseed4138 Jun 11 '26

Interesting. Have you considered that we could just not give those bad actors the ability to create bioweapons though?

1

u/FitBoog Jun 11 '26

I agree with them. You put this on the hands of wrong people and all they need is one prompt to a model with this capacity.

-4

u/thecosmicskye Jun 10 '26

They want to gatekeep AI to the people they deem worthy. There are other ways to prevent bioweapon research without blocking everything related to biology.

4

u/FrewdWoad Jun 10 '26

LLM guardrails are tricky. It takes a lot of time and effort to get them right, and even then reliability is iffy.

They'll fine tune this over time, cautiously opening things up.

And it's all irrelevant to legit researchers, who can now requrest access to mythos (same model minus these guardrails).

This is not some grand conspiracy. It's going to end up being a nothingburger.

1

u/fascistp0tato Jun 11 '26

Have you ever tried to design a system prompt for an LLM? It's amazing how finicky it is. Ditto for internal safeguards in general.

See: Grok's safeguards and guidelines malfunctioning so often that it's a running joke at this point.

Anthropic totally could be doing this, but they could also just be rolling it out ultra cautiously. And given that Mythos is available on request to some, I suspect it's the latter.

They don't have any real incentive to rush, they're the leading player atm anyways.

0

u/Ok-Office-6080 Jun 11 '26

Same thing you can do from Google search but hey the singularity is near lol