GPT-2, every mention
21 scenes · ← back to GPT-2
tap a year for its mentions
every year anyone Marc Andreessen 5Martin Casado 2Dario Amodei 2Amjad Masad 2Surya Ganguli 1Reid Hoffman 1Patrick Hsu 1Mark Chen 1Justin Johnson 1Jakub Pachocki 1
Verbatim, from the transcripts: the passages where GPT-2 comes up
Marc Andreessen’s Worldview in 60 Minutes | Live on MTS
- ▶ 34:46 Marc Andreessen Um, because, you know, look, the, the reality is that, that, you know, the large language models that we had between call it 19, yeah, or, uh, sorry, 20, call it between like GPT two to GPT
The AI Opportunity that goes beyond Models
- ▶ 6:53 Alex Rampell Um, I remember we have a partner here, Frank Chen, who's been here for a very, very long time, and he demoed ChatGPT or GPT-II.
Amjad Masad & Adam D’Angelo: How Far Are We From AGI?
- ▶ 7:31 Amjad Masad In the, in the true pre-training scaling era, you know, GPT-II, three, 3.5, maybe up to four, um, it, it felt like you, you can just, uh, put more internet data in there and just, it just got better.
Marc Andreessen & Amjad Masad on “Good Enough” AI, AGI, and the End of Coding
- ▶ 42:15 Amjad Masad And, um, and so I, I, I would have just expected, like, when we went from GPT-II to III, it was clear it was getting a lot more human.
Reid Hoffman on AI, Consciousness, and the Future of Labor
- ▶ 18:24 Reid Hoffman Like this is one of the things that like when I look at, you know, GBD two, three, four or five, it's a progression of savants.
Is AI Slowing Down? Nathan Labenz Says We're Asking the Wrong Question
- ▶ 7:04 Erik Torenberg And so the difference between GPT two and GPT three and the GPT three and GPT four.
From Vibe Coding to Vibe Researching: OpenAI’s Mark Chen and Jakub Pachocki
- ▶ 1:28 Mark Chen You had, uh, the GPT kind of two, three, four series, which were kind of these instant response models.
- ▶ 3:00 Jakub Pachocki I think another thing that's maybe even more important, but a little bit subtler, when we were in this like GPT-II, GPT-III, GPT-IV era, um, you know, there was kind of one recipe you just like
Dylan Patel on the AI Chip Race - NVIDIA, Intel & the US Government vs. China
- ▶ 1:16:49 Dylan Patel And so like, you know, it was like really impressive when GPT, uh, you know, two was trained on so many chips and then GPT three was trained on that, you know, like on, on, on 20 K 100
Faster Science, Better Drugs
- ▶ 15:28 Patrick Hsu I find it helpful to frame these in terms of like GPT one, two, three, four, five capabilities, right?
Jack Altman & Martin Casado on the Future of Venture Capital
- ▶ 37:31 Martin Casado Of AI, and then somehow that created this, you know, very interesting kind of intellectual journey on the perils of AI, but then, you know, like, GPT-II lands, and these two things got totally conflated.
How Scale AI is Pioneering the Future of Work
- ▶ 45:35 Ben Scharfstein GPT three drafts off of, you know, GPT two and four, whatever, five, but it's like going to be pretty irrelevant later.
Aaron Levie and Steven Sinofsky on the AI-Worker Future
- ▶ 50:51 Aaron Levie Um, and I, I think it was, I think it was basically, uh, a phenomenon in the first wave, which was if you were just doing, like, basic, like, like, if you had figured out that you could do something on GPT, you know, two and three, where…
The Current Reality of American AI Policy: From ‘Pause AI’ to ‘Build’
- ▶ 16:11 Martin Casado GPT-II comes out, and then III comes out, and like, oh, this stuff's amazing, and somehow it got conflated.
Balaji Srinivasan: How AI Will Change Politics, War, and Money
- ▶ 2:42 Balaji Srinivasan And, you know, GPT-II and so on was interesting.
Marc & Ben on AI Policy, Safety, Censorship & Unexpected Risks
- ▶ 24:34 Ben Horowitz And if you look at like the improvement from GPT, uh, two point O to GPT three to 3.5, and then compare that from like 3.5 to four, you know, we've really slowed down in terms of the amount of improvement.
AI at the Intersection of Bio | Vijay Pande, Surya Ganguli & Bowen Liu
- ▶ 0:35 Surya Ganguli Like, I'd seen GPT-II.
“The Future of AI is Here” — Fei-Fei Li Unveils the Next Frontier of AI
- ▶ 23:37 Justin Johnson But, uh, then at some point, like, around, like, around the GPT-II time, like, you couldn't really do those kind of models anymore in academia, because they took way, way more resourcing.
Trump Vs. Biden: Tech Policy
- ▶ 47:32 Marc Andreessen Um, you know, when, when OpenAI first released GPT-II, which was kind of the first LLM that, that worked, they actually refused to release in the beginning because they had all these warnings about how dangerous it was and the safety and… 4 times in the scene
7 Ways to Boost Retention (Both Pre- and Post-AI)
- ▶ 5:05 unnamed speaker And there's an example of an AI-native companionship product where they actually did this test where they used GPT-one, GPT-two, GPT-three, and they actually tracked the cohort of user retention using each of the models. 2 times in the scene
Improving AI with Anthropic's Dario Amodei
- ▶ 2:49 Dario Amodei So for me, the moment was actually GPT-II in 2019, uh, where, you know, there were two different perspectives on it, right? 2 times in the scene