Chinchilla
3 statements across 2 episodes · 1 bullish · 1 bearish · 2 people on the record · first statement Jul 23, 2024 by Thomas Scialom · said 14 times in 6 episodes since 2024 · across every show →
Mentions by year
brought up most by Thomas Scialom (7), Shawn Wang (1), Jeff Dean (1), Ari Morcos (1)
tap a year for its mentions
2026 2 mentions in 2 episodes 1 per episode
2025 2 mentions in 2 episodes 1 per episode
Everything said about Chinchilla, oldest first
Jul 23, 2024 neutral
Jul 23, 2024 bullish
Scialom: Overtrain models beyond Chinchilla optimal to minimize inference costs
“And so, to be compute efficient at inference time, it's much better to train it much longer training time, even if it's an effort, an additional effort, than to have a bigger model. That's what I call, like, I refer to the chinchilla trap, Not that Chinchilla …”
Aug 29, 2025 negative
Morcos: Kaplan and Chinchilla scaling laws incorrectly assume all data is equal
“And even if you go and you look at the scaling laws work from Kaplan and Chinchilla and all these other things, they all assume IID data which is insane. We know that all data are not created equal, that garbage in garbage out is like the oldest adage in compu…”