GPT-2, every mention
24 scenes · ← back to GPT-2
tap a year for its mentions
every year anyone Elad Gil 7Sarah Guo 2Johnny Yu 2Amjad Masad 2Sal Khan 1Oriol Vinyals 1Noam Brown 1Mustafa Suleyman 1Ilya Sutskever 1Gabe Pereyra 1
Verbatim, from the transcripts: the passages where GPT-2 comes up
Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI
- ▶ 17:45 Andrej Karpathy Yeah, I, I didn't expect it to work because, so I have the Project NanoChat, um, and fundamentally, like, I think a lot of people are very confused with my obsession for, like, training GPT-II models and so on, but for me, uh, training…
No Priors Ep. 142 | With Harvey Co-Founder and President Gabe Pereyra
- ▶ 31:53 Gabe Pereyra You saw GPT-I, GPT-II, GPT-III.
No Priors Ep. 141 | With Sunday Robotics Co-Founders Tony Zhao and Cheng Chi
- ▶ 1:51 unnamed speaker It's like, we know there's sign of life for the algorithms people are picking, but people don't know if we have more data, like what happened to GPT-II, GPT-III, what will happen.
No Priors Ep. 103 | With Vevo Therapeutics and the Arc Institute
No Priors Ep. 91 | With Cohere Co-Founder and CEO Aidan Gomez
- ▶ 3:30 Aidan Gomez And at that stage, GPT-II had just come out and it was pretty clear the trajectory of the technology.
No Priors Ep. 86 | With Sarah Guo & Elad Gil
- ▶ 5:10 Elad Gil Uh, you know, I remember when, I can't remember as VPT two or three came out, uh, people were already talking about, well, what if you can create NPCs that are intelligent, interact with you in a way that makes them feel like people.
- ▶ 16:18 Elad Gil Yeah, it's kind of like GPT-II for that approach, and the idea is that that could scale further over time, and it's, it's kind of the initial early proof point that you feel like something really real is happening.
No Priors Ep. 74 | With Google DeepMind VP of Research Oriol Vinyals
- ▶ 17:29 Oriol Vinyals So, of course, the GPT-II paper especially posed that sort of
No Priors Ep. 65 | With Scale AI CEO Alexandr Wang
- ▶ 5:57 Alexandr Wang So we partnered with OpenAI at that time to do the very first experiments on RLHF on top of GPT-II.
No Priors Ep.61 | OpenAI's Sora Leaders Aditya Ramesh, Tim Brooks and Bill Peebles
- ▶ 23:58 Bill Peebles Yeah, so as we look, you know, forward to, you know, like the GPT-II or GPT-III moments, I think we're really excited for very complex long-term physical interactions to become much more accurate.
- ▶ 29:36 Aditya Ramesh I think maybe the biggest update to people with the release of Sora is that internally, we've always made an analogy, as Bill and Tim said, between Sora and GPT models, in that, um, you know, when GPT-I and GPT-II came out, it started to…
No Priors Ep. 47 | With Sourcegraph CTO Beyang Liu
- ▶ 5:33 Beyang Liu I remember chatting with someone who had essentially implemented that on top of GPT-II at the time, and it wasn't nearly as good as it is now, even then, you know, like,
No Priors Ep. 44 | With Former Square CEO Alyssa Henry
- ▶ 5:19 Alyssa Henry And then more recently, even kind of prior to this kind of latest, um, big shift in the AI landscape, you know, we, we were using GPT two, um, as part of us, the square messages product, um, being, uh, you know, a virtual assistant to…
- ▶ 8:08 Elad Gil Because, I mean, adopting GPT-II was super early, right?
- ▶ 15:04 Sarah Guo Can I, uh, ask you to tell us a story of how you guys ended up, um, playing with GPT two for, uh, I think it was like customer, like merchant facing responses to begin with, because that was, we have other, um, a lot and I,
- ▶ 38:29 Sarah Guo And it takes people who are playing with GPT-II or like an eight by eight image to picture what quality and scale improvement can, um, can happen.
No Priors Ep. 39 | With OpenAI Co-Founder & Chief Scientist Ilya Sutskever
- ▶ 13:02 Ilya Sutskever GPT-I started to show very interesting signs of life, and that led us to doing GPT-II, and then ultimately GPT-III.
- ▶ 13:24 Elad Gil I mean, for me, the big wake up moment to your point was GPT-II to GPT-III transition where you saw such a big step function and capabilities.
No Priors Ep. 33 | With Replit's CEO & Co-Founder Amjad Masad
- ▶ 3:43 Amjad Masad And every year or two while starting Replit, I would go look at the state of the art on ML on code and nothing ever really worked all that well up until GPT-II. 2 times in the scene
No Priors Ep. 28 | With Khan Academy’s Creator Sal Khan
No Priors Ep. 18 | With Kevin Scott, CTO of Microsoft
No Priors Ep. 16 | With Mustafa Suleyman, Founder of DeepMind and Inflection
- ▶ 24:03 Mustafa Suleyman Um, I, I had seen the GPT-II work.
No Priors Ep. 2 | With Runway ML’s Cristobal Valenzuela
- ▶ 11:05 Cristobal Valenzuela Someone was training a model and, like, fine-tuning a GPT-II model on a specific corpus of data and then
No Priors Ep. 1 | With Noam Brown, Research Scientist at Meta
- ▶ 7:27 Noam Brown In 2019, you had GPT-II come out, which was just mind-blowing, and then you also had, you know, DeepMind Grandmasters in StarCraft II, you had OpenAI beating human experts in Dota II, and that was just after, like, a couple of years of,…