StarZero All shows Try the podcast clipper →

model distillation

3 statements across 3 episodes · 1 bullish · 1 bearish · 3 people on the record · first statement Aug 5, 2024 by Dmitry Dolgov · across every show →

Everything said about model distillation, oldest first

Aug 5, 2024 positive
Insight
Dolgov: Distilling huge AI models beats training small models directly
“Where you're much better off training a huge model and then distilling it into a smaller model than just training small models.”
Dmitry Dolgov Aug 5, 2024 ▶ 14:37 How Waymo Is Using GenAI to Build a Better Driver
Aug 15, 2025 neutral
Insight
Midha: Distilling frontier capabilities from US AI outputs is easy
“No, actually it's not that hard to distill on the outputs of our labs.”
Anjney Midha Aug 15, 2025 ▶ 9:58 The Current Reality of American AI Policy: From ‘Pause AI’ to ‘Build’
Aug 5, 2026 negative
Opinion
Moe: Model distillation is not the primary driver of Chinese AI progress
“So I really don't think from currently what we're seeing this is a big cornerstone of what's powering the progress today. In the end, what's powering the progress is still just really smart people with very interesting algorithms, data environment, and they wi…”
Simon Moe Aug 5, 2026 ▶ 44:13 How Open Source Became AI's Backbone | Inferact with a16z
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more