GPT-2

2 statements across 2 episodes · 0 bullish · 0 bearish · 2 people on the record · first statement Jun 24, 2024 by David Luan · said 14 times in 9 episodes since 2024 · across every show →

Mentions by year

brought up most by David Luan (3), Mikey Shulman (2), Harry Stebbings (2), Sam Altman (1), Matan Grinberg (1), Jake Saper (1), Cliff Weitzman (1), Arvind Narayanan (1)

tap a year for its mentions
004284202420252026episodesmentions
024202420252026episodes it came up in
001224202420252026episodesmentions per episode
2026 2 mentions in 2 episodes 1 per episode
2025 4 mentions in 3 episodes 1 per episode
2024 8 mentions in 4 episodes 2 per episode

every mention, scene by scene, with the transcript →

Everything said about GPT-2, oldest first

Jun 24, 2024
Assertion Contradicted
Luan: Scaling GPT-2 without architectural changes unlocked three-digit arithmetic
“When we were training GPT-II, we trained GPT-II in various different sizes. And at the smallest size, the model was just, like, unable to do three-digit arithmetic. But as the models got bigger and bigger and bigger, we didn't change anything else. We just had…”
David Luan Jun 24, 2024 ▶ 17:20 David Luan: Why Nvidia Will Enter the Model Space & Models Will Enter the Chip Space | E1169 · 20VC with Harry Stebbings
Apr 11, 2025
Assertion Supported
Nayak: Scale AI Partnered With OpenAI on Early GPT-2 RLHF
“Scale partnered with open AI very, very early on before chat GPT came out. This was like very early on RLHF when they were trying to tune models to summarize better based off of Reddit passages. And this is on GPT two.”
Aatish Nayak Apr 11, 2025 ▶ 8:22 20Product: How Scale AI and Harvey Build Product | Why PMs Are Wrong: They are not the CEOs of the Product | How to do Pre and Post Mortems Effectively and How to Nail PRDs | The Future of Product Management in a World of AI with Aatish Nayak
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.