Mann: Anthropic focuses RSP safety on biology over nuclear risks
Ben Mann · No Priors Ep. 118 | With Anthropic Co-Founder Ben Mann · Jun 12, 2025 · at 30:19
Ben Mann, co-founder of Anthropic, explains how the company prioritizes catastrophic risks in its Responsible Scaling Policy.
0:00 / 0:40exact quote · 40.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Initially, our RSP talked about CVRN, which is chemical, radiological, nuclear, and biological risks, which are different areas that could cause severe loss of life in the world, and that's how we thought about the harms, but now we're much more focused on biology, because if you think about, like, the amount of resources that you would need to cause a nuclear harm, you'd probably have to be Like a state actor to get those resources and be able to use them in a harmful way. Whereas a much smaller group of random people could get their hands on the reagents necessary for biological harm.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Ben Mann
Mann: Competitors ran 'code reds' to match Claude in coding and failed
“And I know that other companies have had like code reds for trying to catch up in coding capabilities for quite a while and have not been able to do it.”
Mann: Opus 4 triggered ASL-3 safety protocols due to biological threat capabilities
“And so one of the reasons that our most recent model, Opus IV, is classified as ASL III. Is because it did have significant uplift relative to a Google search.”
Ben Mann: General superintelligence by 2028 is 'quite possible'
“I think it's quite possible. I think it's very hard to put confident bounds on, on the numbers, but”
Mann: Anthropic's 'model welfare lead' tests letting Claude opt out of chats
“We have this other project led by Kyle Fish, our model welfare lead. Where Claude can actually opt out of conversations if it's going too far in the wrong direction.”