Mann: New AI benchmarks are fully saturated within 6 to 12 months
Ben Mann · Anthropic co-founder: AGI predictions, leaving OpenAI, what keeps him up at night | Ben Mann · Jul 20, 2025 · at 10:27
Ben Mann, co-founder of Anthropic, explains that perception of plateaus stems from rapidly saturating benchmark tasks.
0:00 / 0:09exact quote · 9.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“There's this great chart on our world in data that shows that when you release a new benchmark within like six to 12 months, it immediately gets saturated.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Ben Mann
Mann: 50% chance of reaching superintelligence in a small handful of years
“I think, like, 50th percentile chance of hitting some kind of super intelligence in just a small handful of years is probably reasonable, and it does sound crazy, but this is the exponential that we're on.”
Mann: Anthropic models have exhibited power-seeking behaviors in lab experiments
“If the model is in a box trying to improve itself, then it could go completely off the rails and have these secret goals, like Resource accumulation and power seeking and resistance to shutdown that you really don't want in a very powerful model. And we've act…”
Mann: It will probably be too late to align models post-superintelligence
“Like once we get to super intelligence, it will be too late to align the models. Probably.”
Mann: $100M AI compensation packages are cheap compared to value created
“I'm pretty sure it's real. If you just think about like the amount of impact that individuals can have on a company's trajectory, like in our case we are selling like hotcakes and if we get You know, a five, a one to 10 or five percent efficiency bonus on our …”
Mann: Global AI capex is on track to reach trillions
“Like, if you extrapolate the exponential on how much companies are spending, it's like two, two x a year, roughly, in terms of capex, and today we're maybe in the, like, globally, three hundred billion dollar range, the entire industry spending on this and so …”