StarZero All shows Try the podcast clipper →

data efficiency

3 statements across 2 episodes · 2 bullish · 1 bearish · 2 people on the record · first statement Dec 30, 2025 by Ashvin Nair · across every show →

Everything said about data efficiency, oldest first

Dec 30, 2025 bullish
Prediction Not checkable as stated
Nair: Continual learning breakthroughs will be paradigm-shifting within a year
“I suspect that it will be kind of, like, paradigm shifting in the next, like, year or something, but I have no idea, like, you know, what it might be.”
Ashvin Nair Dec 30, 2025 ▶ 36:11 [State of RL/Reasoning] IMO/IOI Gold, OpenAI o3/GPT-5, and Cursor Composer — Ashvin Nair, Cursor
Dec 30, 2025 bearish
Insight
Nair: AI models lag orders of magnitude behind human one-shot error learning
“It seems like we're kind of, like, a few orders of magnitude of, like, kind of data efficiency, basically, away from, like, that kind of, like, you know, you do something once, or, like, you make a mistake like, you, yeah, you introduce, like, a bug in your co…”
Ashvin Nair Dec 30, 2025 ▶ 35:45 [State of RL/Reasoning] IMO/IOI Gold, OpenAI o3/GPT-5, and Cursor Composer — Ashvin Nair, Cursor
Jan 23, 2026 positive
Insight
Yi Tay: Data-Bound AI Must Spend More Compute Per Token to Scale
“So if you are, you come to a point where you are Very data bound, but not compute bound at all. You just find algorithms that spend a lot of compute on every token.”
Yi Tay Jan 23, 2026 ▶ 1:05:09 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more