Anthropic co-founder Ben Mann discusses the disproportionately small number of researchers dedicated to AI safety relative to overall AI industry capital expenditures.
“If you look at, like, who in the world is actually working on safety problems, it's a pretty small set of people even now. I mean, the industry is blowing up, as I mentioned, like, three hundred billion a year CapEx today, and Then I would say like maybe less than a thousand people working on it worldwide, which is just crazy.”
quote is from the automated transcript, cleaned for reading:
filler sounds and stutters are removed, nothing is rephrased. names can be misheard
(the analysis reads context, assessments check outside sources). how →
More from Ben Mann
PredictionNot checkable as stated
Mann: 50% chance of reaching superintelligence in a small handful of years
“I think, like, 50th percentile chance of hitting some kind of super intelligence in just a small handful of years is probably reasonable, and it does sound crazy, but this is the exponential that we're on.”
Ben MannJul 20, 2025▶ 46:12Anthropic co-founder: AGI predictions, leaving OpenAI, what keeps him up at night | Ben Mann
AssertionSupported
Mann: Anthropic models have exhibited power-seeking behaviors in lab experiments
“If the model is in a box trying to improve itself, then it could go completely off the rails and have these secret goals, like Resource accumulation and power seeking and resistance to shutdown that you really don't want in a very powerful model. And we've act…”
Ben MannJul 20, 2025▶ 54:46Anthropic co-founder: AGI predictions, leaving OpenAI, what keeps him up at night | Ben Mann
PredictionNot checkable as stated
Mann: It will probably be too late to align models post-superintelligence
“Like once we get to super intelligence, it will be too late to align the models. Probably.”
Ben MannJul 20, 2025▶ 42:49Anthropic co-founder: AGI predictions, leaving OpenAI, what keeps him up at night | Ben Mann
Opinion
Mann: $100M AI compensation packages are cheap compared to value created
“I'm pretty sure it's real. If you just think about like the amount of impact that individuals can have on a company's trajectory, like in our case we are selling like hotcakes and if we get You know, a five, a one to 10 or five percent efficiency bonus on our …”
Ben MannJul 20, 2025▶ 6:37Anthropic co-founder: AGI predictions, leaving OpenAI, what keeps him up at night | Ben Mann
PredictionHeld up
Mann: Global AI capex is on track to reach trillions
“Like, if you extrapolate the exponential on how much companies are spending, it's like two, two x a year, roughly, in terms of capex, and today we're maybe in the, like, globally, three hundred billion dollar range, the entire industry spending on this and so …”
Ben MannJul 20, 2025▶ 7:19Anthropic co-founder: AGI predictions, leaving OpenAI, what keeps him up at night | Ben Mann
AssertionNot checkable as stated
Mann: Reinforcement learning has allowed AI scaling laws to continue
“If you look at the scaling laws, they're continuing to hold true. We did kind of need this transition from like normal pre-training to reinforcement learning, scaling up to continue the scaling laws.”
Ben MannJul 20, 2025▶ 8:56Anthropic co-founder: AGI predictions, leaving OpenAI, what keeps him up at night | Ben Mann
Made with StarZero
Turn any episode into a week of clips.
This entire site, over 300 episodes transcribed, diarized, checked and made playable,
runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the
moments worth sharing, cuts them, captions them, and reframes them for every feed.
We use essential cookies to make the site work. With your permission we
also use analytics cookies (Google Analytics and Mixpanel) to understand
usage and improve StarZero. See our Cookie Policy.