Assertion certainty 4/5 debate potential 2/5

Douglas: Even AI pioneer Noam Shazeer only sees 10% of ideas work

Sholto Douglas · Sonnet 4.5 & the AI Plateau Myth — Sholto Douglas (Anthropic) · Oct 2, 2025 · at 24:47

Sholto Douglas, an AI researcher at Anthropic, discusses the low success rate of ideas in frontier AI research, quoting Transformer co-author Noam Shazeer.

0:00 / 0:18exact quote · 18.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I once asked this question of Noam Chazier. And he was like, yeah, maybe like 10% of my ideas work, and that's not, right? You know, one of the, you know, an absolute genius, one of the best in the field. So if only 10% of his ideas work, then I think that, you know, establishes a bound on on the percentage of ideas work. Most don't.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Sholto Douglas

Prediction Not checkable as stated
Douglas: Anthropic believes AGI is reachable in a couple of years
“We think that, you know, AGI is within reach in the next couple of years.”
Sholto Douglas Oct 2, 2025 ▶ 27:33 Sonnet 4.5 & the AI Plateau Myth — Sholto Douglas (Anthropic)
Prediction Open · timeframe Oct 2028
Douglas: AI industry will reach human-level computer capabilities in 2-3 years
“Which is that in the next two or three years, given the right feedback loops, given the right compute, given the right, you know, elbow grease and this kind of stuff, we think that we as the AI industry are all on track to create something that is at least as …”
Sholto Douglas Oct 2, 2025 ▶ 59:06 Sonnet 4.5 & the AI Plateau Myth — Sholto Douglas (Anthropic)
Assertion Not checkable as stated
Douglas: Transformers successfully model any domain given sufficient data and compute
“I don't think that's true. I think we haven't yet really found anything that transformers haven't been able to model provided sufficient data and sufficient compute.”
Sholto Douglas Oct 2, 2025 ▶ 1:00:25 Sonnet 4.5 & the AI Plateau Myth — Sholto Douglas (Anthropic)
Insight
Douglas: Independent technical blogs are the highest AI hiring signals
“The fastest route, or like, the most immediate one is whenever we see a really good blog post where people have, like, done incredible amount of work in an independent fashion, it's one of the highest signal things there is.”
Sholto Douglas Oct 2, 2025 ▶ 10:54 Sonnet 4.5 & the AI Plateau Myth — Sholto Douglas (Anthropic)
Prediction Not checkable as stated
Douglas predicts DeepMind will lead the world in AI science discoveries
“DeepMind, if you wanted to solve science, is the best place in the world. Like, I think that DeepMind will directly contribute to more scientific discoveries from AI than anything else, right?”
Sholto Douglas Oct 2, 2025 ▶ 16:54 Sonnet 4.5 & the AI Plateau Myth — Sholto Douglas (Anthropic)
Disclosure
Douglas: Anthropic's ethos is that scaling current techniques achieves AGI
“Like really for the last five or six years, Anthropics ethos has been scaling compute with broadly the current set of techniques is like AGI is tractable within those bounds.”
Sholto Douglas Oct 2, 2025 ▶ 27:52 Sonnet 4.5 & the AI Plateau Myth — Sholto Douglas (Anthropic)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.