InstructGPT
product on 11 shows · 3 statements across 3 episodes · said 32 times in 23 episodes since 2023
Latent Space 13 
No Priors 4 
TBPN 3 
the Y Combinator Startup Podcast 2 
Lenny's Podcast 2 
the Neon Show 2 
20VC 2 
We Live to Build 1 
A Product Market Fit Show 1 
Sourcery 1 
the MAD Podcast 1
Mentions by year, every show
tap a year for its mentions
Latent Space 13No Priors 4TBPN 3the Y Combinator Startup Podcast 2Lenny's Podcast 220VC 2the Neon Show 2We Live to Build 13 more shows
2026 5 mentions in 4 episodes 1 per episode
- Mercor Head of Product on Revenue Concentration from Frontier Labs
- The Man Training GPT, Gemini & Claude Reveals What's Coming Next | Vijay Krishnan, Turing
- Why Coding is the Fastest Path to AGI | Turing CEO Jonathan Siddharth
- Everything Gets Rebuilt: The New AI Agent Stack | Harrison Chase, LangChain
- every mention in 2026, scene by scene →
2025 13 mentions in 10 episodes 1 per episode
- Information Theory for Language Models: Jack Morris
- The rise of Cursor: The $300M ARR AI tool that engineers can’t stop using | Michael Truell
- [State of RL/Reasoning] IMO/IOI Gold, OpenAI o3/GPT-5, and Cursor Composer — Ashvin Nair, Cursor
- How Josh Kushner Became The Most Powerful VC in New York
- Inside The $2.2B AI Research Accelerator | Turing · Sourcery with Molly O'Shea
- He quit his job, went all-in on AI agents—then grew to 100K users & a $30M Series A in a year. | ... · PMF Show
- Weekly Recap: CEO Affair at Coldplay Concert, Elon Musk's AI Girlfriend, Cognition Acquires Windsurf
- DWARKESH PATEL on the Biggest Problem of AI
- 2 more episodes that year, every mention in 2025 →
2024 8 mentions in 4 episodes 2 per episode
- The Origin and Future of RLHF: the secret ingredient for ChatGPT - with Nathan Lambert
- Training Llama 2, 3 & 4: The Path to Open Source AGI — with Thomas Scialom of Meta AI
- No Priors Ep. 65 | With Scale AI CEO Alexandr Wang
- High Agency Pydantic over VC Backed Frameworks — with Jason Liu of Instructor
- every mention in 2024, scene by scene →
2023 6 mentions in 5 episodes 1 per episode
- No Priors Ep. 3 | With Stability AI’s Emad Mostaque
- Beating GPT-4 with Open Source Models - with Michael Royzen of Phind
- 550 Million People, One Language, Zero Access to Venture Capital
- No Priors Ep. 15 | With Kelvin Guu, Staff Research Scientist, Google Brain
- The REAL potential of generative AI · Y Combinator
- every mention in 2023, scene by scene →
every mention on every show, scene by scene, with the transcript →
3 statements about InstructGPT, every show
Lambert: RLHF Performance Depends on Data and Systems Over RL Details
“It really ends up being kind of, like, gibberish that I think is less important now, because it's more about data and infrastructure than RL details, than, like, value functions and everything. A lot of the papers have different terms in the equations. I think…”
Royzen: BigScience's T-Zero predated InstructGPT in large-scale instruction tuning
“I think T-Zero is the first model that did large-scale instruction tuning from diverse data sources in the fall of twenty-twenty-one. This is before InstructGPT. This is before Flan T-Five, which came out in twenty-twenty-two. This is, I think, the very, very …”
Habib: OpenAI's 1.3B InstructGPT beat the 100x larger GPT-3 via RLHF
“In the InstructGPT paper that OpenAI released, they compared, you know, a one or two billion parameter model with instruction tuning and RHF to the full GPT-III model and people preferred that despite the fact it was a hundred times smaller.”