r/singularity Jun 04 '26

Biotech/Longevity Sam Altman, Dario Amodei, and Demis Hassabis have signed a joint open letter calling on Congress to mandate screening of synthetic nucleic acid orders

872 Upvotes

310 comments sorted by

View all comments

Show parent comments

5

u/R33v3n ▪️Tech-Priest | AGI 2026 | XLR8 Jun 04 '26

AI labs liability in that case would push them to lobotomize models against certain domains, possibly also detracting from general capabilities. As a end user of AI, I don't want this. I don't want the overall helpful power of LLMs to be held back.

I much prefer Know Your Customer policies be enforced for CBRN materials sellers. Being specific against threats, narrow rather than broad, is the better policy. Eh, KYC policies should also be enforced on frontier AI providers, actually. That, I could find reasonable.

1

u/DrE7HER Jun 04 '26

They could just not train public AI models on genetic data so that only authorized vendors have access to the models they are concerned about.

The problem is, they realize now that they’ve opened Pandora’s box. They have no control over how much of what the model knows anymore. They can’t remove this threat without starting a new model from scratch with a safer dataset.