Chinchilla, every mention
6 scenes · ← back to Chinchilla
tap a year for its mentions
every year anyone Thomas Scialom 7Shawn Wang 1Jeff Dean 1Ari Morcos 1
Verbatim, from the transcripts: the passages where Chinchilla comes up
The AI Frontier: from Gemini 3 Deep Think distilling to Flash — Jeff Dean
Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
- ▶ 56:35 unnamed speaker Last time that we were on the podcast, we talked about chinchilla versus inference optimal training.
Better Data is All You Need — Ari Morcos, Datology
- ▶ 8:25 Ari Morcos And even if you go and you look at the scaling laws work from Kaplan and Chinchilla and all these other things, they all assume IID data, um, which is insane.
2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents
- ▶ 8:32 Shawn Wang Chinchilla paper is compute optimal training, but what is not stated in there is it's pre-trained compute optimal training.
Training Llama 2, 3 & 4: The Path to Open Source AGI — with Thomas Scialom of Meta AI
- ▶ 9:28 Thomas Scialom It's also because the project was taking some routes to reproducing a chinchilla, which was a seven TB. 7 times in the scene
Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI
- ▶ 42:21 unnamed speaker Um, uh, the most interesting thing for, for, for us covering on this, in this podcast was, uh, the death of Chinchilla, as people say. 3 times in the scene