scaling laws

4 statements across 4 episodes · 2 bullish · 0 bearish · 4 people on the record · first statement Oct 10, 2024 by Richard Socher · across every show →

Everything said about scaling laws, oldest first

Oct 10, 2024 bullish

Prediction Not checkable as stated

Socher: Scaling laws will show major progress in non-text modalities

“I think we're going to see incredible progress in scaling laws in just these new modalities.”

Richard Socher Oct 10, 2024 ▶ 22:36 AGI, The Future of AI Agents And The Next Wave of Opportunities in AI | Richard Socher, CEO, You.com

Oct 23, 2025 neutral

Assertion Not checkable as stated

AI research still lacks scaling laws for training data quality

“I think we don't have any good scaling laws yet. That tell us the trade off, especially I think because it's very hard to measure what is the quality of a data point, right? Like how good is this example compared to this other example without being able to mea…”

Julian Schrittwieser Oct 23, 2025 ▶ 46:26 Are We Misreading the AI Exponential? Julian Schrittwieser on Move 37 & Scaling RL (Anthropic)

Nov 26, 2025 positive

Assertion Not checkable as stated

Kaiser: Pre-training scaling laws still hold across OpenAI and Google

“What scaling clause says is that your loss will log linearly decrease with your compute. We totally see that and clearly Google sees that and all other labs.”

Łukasz Kaiser Nov 26, 2025 ▶ 4:35 What’s Next for AI? OpenAI’s Łukasz Kaiser (Transformer Co-Author)

Dec 18, 2025

What-if

Bourgeau: Would not have bet heavily on scaling laws materializing

“I, I'm not sure if I would have bet a lot on, on that actually materializing and being where we are today.”

Sebastien Bourgeau Dec 18, 2025 ▶ 5:26 ”We’re Ahead of Where I Thought We’d Be” — Gemini 3 & the Future of AI

scaling laws

Everything said about scaling laws, oldest first

Turn any episode into a week of clips.