distillation

2 statements across 2 episodes · 1 bullish · 0 bearish · 2 people on the record · first statement Nov 26, 2025 by Łukasz Kaiser · across every show →

Everything said about distillation, oldest first

Nov 26, 2025 positive

Insight

Kaiser: Distillation lets OpenAI combine research projects without long pre-training runs

“With distillation, you have the ability to put a number of projects into one model. It's kind of nice that you don't need to wait on all of them to complete at the same time. You can try to periodically put this together, actually make sure that as a product i…”

Łukasz Kaiser Nov 26, 2025 ▶ 45:36 What’s Next for AI? OpenAI’s Łukasz Kaiser (Transformer Co-Author)

Feb 12, 2026

Insight

Lacroix: Focused use cases allow for significantly smaller AI models

“The more focused your use case is, the smaller you can make the model through fine-tuning or through just distillation in an even smaller architecture.”

Timothée LeCroix Feb 12, 2026 ▶ 34:00 Mistral AI vs. Silicon Valley: The Rise of Sovereign AI

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

distillation

Everything said about distillation, oldest first

Turn any episode into a week of clips.