model distillation
3 statements across 3 episodes · 2 bullish · 1 bearish · 3 people on the record · first statement Mar 3, 2025 by Mike Krieger · across every show →
Everything said about model distillation, oldest first
Mar 3, 2025 positive
Krieger: AI Labs Use Internal Distillation to Reduce Latency and Costs
“Even, like, let's take within the labs, like, I assume every single one of the labs is using, like, even within themselves, like, it is very valuable to be able to take, you know, the knowledge of your highest-end model and then be able to make it higher, you …”
Jul 23, 2026 negative
Aug 9, 2026 positive
Atallah: Most Chinese open-weight models permit distillation for reinforcement learning
“The nice thing about the open weight models and the Chinese models that they allow distillation and they like most of them. And that means that you can like take the outputs of these models to do reinforcement learning on top of the model that you're building.”