distillation
2 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Apr 22, 2026 by Greg Brockman · across every show →
Everything said about distillation, oldest first
Apr 22, 2026 bearish
Brockman: Distilling AI models fails because frontier progress is exponential
“There's certainly a lot of attempts to distill models. And that comes from companies in the U S it comes from all over the world. But I think that it misses the core point, which is that the way this technology is developing is it is on an exponential. And any…”
Apr 22, 2026
Brockman: OpenAI hides chain of thought to preserve faithfulness and prevent distillation
“So there's two reasons. One is to think about distillation, but the second, in some ways more important, is that we had this insight when we first developed the reasoning paradigm that it gives us a interpretability mechanism we had not been anticipating, beca…”