Everything Ashvin Nair said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Nair: LLM agents will hit $1T before robotics hits $10B
“It feels like LLM agents are going to be like a trillion dollar market before robotics is maybe even like a ten billion dollar market.”
Nair: 2017–2022 academic RL breakthroughs failed because researchers overfit to benchmarks
“A lot of the methods that people were really excited about is, like you know, off policy learning, like, value functions, like, these kind of things, and somehow that, that stuff hasn't really panned out, I would say, and it's not exactly clear why, but in the…”
Nair: Academia rewards complex math over simple, generalizable solutions
“One of the pitfalls of academia is that it doesn't really reward, like, simple ideas that work, and instead kind of tends to reward, like, kind of mathier ideas. Those mathier ideas also give you these, like, kind of implicit knobs to tune that allow you to, l…”
Nair: RL on LLMs is peaky and fails to generalize beyond training
“RL, the way it's applied to LLMs right now, is kind of a weird, funny tool where it doesn't really generalize beyond the training distribution that much. It generalizes to some extent, and generalizes in interesting ways, but It's like very peaky, right? Like …”
Nair: Context integration, not model intelligence, bottlenecks useful automation
“A big thing that needs to happen is, like, it's not, it doesn't feel like intelligence of the models is the bottleneck. It's more like you just have products that bring the entire context of what someone wants to do into the product so that the LLM can, like, …”
Nair: OpenAI model splits happen because it ships its org chart
“OpenAI has a tendency to ship the org chart, basically.”
Nair: RLHF Is a Side Branch Because Compute Cannot Be Scaled
“I think human feedback is kind of like a bit of like a side branch, because you can't really pour that much compute Into it, right? It's like, you take the model, and you, like, elicit it to be a little bit better in terms of personality”
Nair: AI will probably reach human-level intelligence around 2030
“And actually, you know, it is, it's somewhere in the, like, twenty-thirty-ish thing that, like, it will probably reach, like, human level intelligence.”
Nair: OpenAI already possessed a superior model during the DeepSeek release
“The feeling in OpenAI is that like, well, I think we had a better model already at the time, right?”
Nair: Frontier AI labs have converged on similar reinforcement learning methods
“Well, it does seem like basically a lot of the labs have kind of like converged onto some similar-ish way of doing RL, and they're all kind of back at the same level of like Frontier again”
Nair: Robotics investments today back teams, not proven technology
“Yeah, I think at this point, especially, it still feels like in robotics, you're not exactly investing in a technology, probably, you're just investing in a team.”
Nair: IOI Gold Mastery Has Not Solved Real-World Coding Automation
“Most programmers in the world cannot do IOI at any decent level. But, like, we're still struggling to, like, automate most programming jobs or, like, you know, there's a lot left to do.”
Nair: Public corporate boards may govern AI more democratically than non-profit boards
“When the blip happened, one of my reactions was like, well, you know, this nonprofit board stuff, like, actually, if it takes such somewhat, like, surprising, Maybe erratic actions, like maybe you'd rather just have, like, you know, a thing like the Microsoft …”
Nair: Sutskever and Pachocki Drove OpenAI's First-Principles Research Conviction
“I think in general, OpenAI is really good about, like, having conviction in something, and just, like, really, like, from first principles, like, going after it, and I think, like, the people who are kind of most responsible for that is probably, like, Ilya Se…”
Nair: OpenAI internal models surpassed forecasters' 2027 benchmark targets before o1 launch
“And their estimates were, like, oh, we'll be at, like, 10, 20% in, like, 20, 27, and I think at the time, there was, like, you know, models internally that were, like, already better than their estimates, so that, like, it's, like, off by, like, you know, two …”
Nair: AI models lag orders of magnitude behind human one-shot error learning
“It seems like we're kind of, like, a few orders of magnitude of, like, kind of data efficiency, basically, away from, like, that kind of, like, you know, you do something once, or, like, you make a mistake like, you, yeah, you introduce, like, a bug in your co…”
Nair: Cursor aims to automate end-to-end software engineering process
“What we're really aiming for is, like, more, like, you know, automate software engineering as a process where you, like, write code, you go look at Datadog look at what's, like, happening, then come back and, like, you know, maybe have some hypotheses about wh…”
Nair: Continual learning during deployment does not risk model capacity overload
“If you could learn enough about those million tokens that you're actually in deployment on I don't think you should need, like, I don't think there's a risk of overloading the capacity of your model, right? Because you can train on a trillion tokens, and it's …”
Nair: Fundamental science is less fruitful than empirical work for AI progress
“There's like actually so many of these kind of more scientific questions that I would like love to explore sometime, but then it really kind of conflicts with like empirical stuff, you know, like unfortunately at any given moment in time, it doesn't seem like …”
Nair: AI robotics is currently in its 'GPT-1 to GPT-2' era
“Yeah, like I would say that robotics is in kind of like the GPT-one to GPT-two area right now.”
Nair: Previously Believed IOI Gold Would Mean AI Was Solved
“If you told me that we could have gotten IOI Gold then, I would have just assumed that we could all just go on vacation, like, you know, it's all over, like, AI is solved, like, no point in working anymore.”
Nair: OpenAI Progress Feels Smooth Internally, Not Like Sudden Leaps
“It seems like externally people are kind of very, like, oh like, research seems to come in these, like, big leaps. But I think internally at OpenAI, it feels very smooth.”
Nair: Continual learning breakthroughs will be paradigm-shifting within a year
“I suspect that it will be kind of, like, paradigm shifting in the next, like, year or something, but I have no idea, like, you know, what it might be.”
Nair: Internal Slack posts replaced reading external papers at OpenAI
“Unfortunately I've like, kind of gotten the habit, especially at OpenAI, of like, not reading that much external work, and just like reading people's like, Slack posts internally. That's like the main, like, way to like, you know like, learn new stuff.”