StarZero All shows Try the podcast clipper →

scaling laws

3 statements across 3 episodes · 1 bullish · 0 bearish · 3 people on the record · first statement Jul 20, 2025 by Ben Mann · across every show →

Everything said about scaling laws, oldest first

Jul 20, 2025 bullish
Assertion Not checkable as stated
Mann: Reinforcement learning has allowed AI scaling laws to continue
“If you look at the scaling laws, they're continuing to hold true. We did kind of need this transition from like normal pre-training to reinforcement learning, scaling up to continue the scaling laws.”
Ben Mann Jul 20, 2025 ▶ 8:56 Anthropic co-founder: AGI predictions, leaving OpenAI, what keeps him up at night | Ben Mann
Nov 16, 2025 neutral
Opinion
Dr. Fei-Fei Li: Scaling laws alone are not enough; AI needs innovation
“I think scaling laws of more data, more GPUs and bigger current model architecture is there's still a lot to be done there, but I absolutely think we need to innovate more.”
Dr. Fei-Fei Li Nov 16, 2025 ▶ 26:48 The Godmother of AI on jobs, robots & why world models are next | Dr. Fei-Fei Li
Jul 26, 2026
Insight
Penn: Scaling loss is smooth, but AI capabilities emerge discontinuously
“As you add in more compute and data, what's called loss, aka the loss from next token prediction goes down. And so it's a very smooth linear curve of, like, the models get more intelligent as you scale them up. What's actually also interesting in that paper is…”
Dianne Penn Jul 26, 2026 ▶ 17:53 Why AI is going vertical (again) | Dianne Penn (Anthropic)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 300 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more