GPT-2, every mention
22 scenes · ← back to GPT-2
tap a year for its mentions
every year anyone Sebastian Raschka 3Gary Marcus 3Francois Chollet 3Sean Gourley 2Gideon Mann 2Clement Delangue 2Amjad Masad 2Stephen Balaban 1Nathan Benaich 1Mike Volpi 1
Verbatim, from the transcripts: the passages where GPT-2 comes up
The GPU Myth: State of AI Compute 2026 | Stephen Balaban
- ▶ 53:33 Stephen Balaban And he was like on a Lambda workstation and he was reading the GPT, uh, two paper.
OpenAI's Dan Roberts: Why AI Can Now Make Discoveries
- ▶ 39:33 Dan Roberts I wasn't at opening at the time, but if you imagine trying to like get small models to, to reason, you know, GPT one, GPT two, GPT three, and then GPT four to the again cartoon.
State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka
- ▶ 2:55 Sebastian Raschka Take a GPT one or two model and with a few, I mean, few lines of code almost, you can transform it into the latest, uh, let's say deep seek version, 3.2 architecture.
- ▶ 56:57 Sebastian Raschka Because I mean, back then it was GPT one, GPT two, GPT three, and now it's GPT four, 4.14 point, I think two or five, five, five, one, five, two, and all the models, they are iterating now, or even the same with deep seek.
- ▶ 1:03:36 Sebastian Raschka And so I have still my GPT two architecture and they are relatively similar.
Chasing Real AGI: Inside ARC Prize 2025 with Chollet & Knoop
- ▶ 10:28 Francois Chollet Has completely resisted the, the paradigm of scaling up these base models like, uh, uh, back in, uh, uh, when I, when I released ARK initially, the best LLM out there was like GPT-II, which of course was completely useless on ARK. 2 times in the scene
- ▶ 36:46 Francois Chollet And GPT-III itself was just a bigger version of GPT-II.
- ▶ 42:55 Mike Knoop One, we were trying to emulate a bit more of what the academic environment around AI research looked like during the 2010 to 20 twenties, where, you know, if you look at even where we got to with language models, that was built on, you…
The AI Coding Agent Revolution, The Future of Software, Techno-Optimism | Amjad Masad, CEO, Replit
- ▶ 32:12 Amjad Masad And then GPT-II came out, and that was the first time when I felt like, okay, this is, this feels like the unlock, because GPT-II can write in my coherent code. 2 times in the scene
State of AI 2024: Frontier Models, AI Geopolitics, Robotics | Nathan Benaich, Air Street Capital
- ▶ 48:20 Nathan Benaich Like, you showed up the computer system, a picture of a baby holding, like, a toothbrush, and it would said, like, a young man holds a baseball bat or something, and, like, there were memes of this on Twitter, and it was so easy to spoof…
The $4.5B Platform Driving the Open Source AI Revolution | Clem Delangue, CEO, Hugging Face
- ▶ 3:47 Clement Delangue It was GPT, GPT-II, there was, there was BERT, there was ExcelNet, um, obviously Google, uh, kicked off this wave with attention is all you need, which is like the seminal paper for, for Transformers, which is the T in, in ChatGPT.
An inside look at “Mastering AI” | Jeremy Kahn, Author & AI Editor, Fortune
- ▶ 2:26 Jeremy Kahn and I'd been following, I had covered GPT-II and I had covered GPT-III and was kind of monitoring what was going on with GPT-III.
From Business to Warfare: How AI Affects the Modern World | Azeem Azhar
- ▶ 7:24 Azeem Azhar I talked about scaling, uh, a little bit from, from, from two to three and the, the improvement that you got through, through scaling.
AI vs. Call Centers: ASAPP CEO Gustavo Sapoznik on the Future of Customer Service
- ▶ 13:04 Matt Turck So in particular, you've been doing this since, which was two years after the resurrection of deep learning or the acceleration of deep learning after a, so you've been at this for a few years and in particular before Transformers and then…
How to Ship Reliable GenAI Apps: Humanloop CEO on LLM Observability, RAG & Rapid Iteration
- ▶ 30:10 unnamed speaker People, when GPT-II came out, they didn't release GPT-II for fear of misuse concerns. 3 times in the scene
A Conversation on The State of AI | Melanie Kambadur, Meta & Gideon Mann, Bloomberg
- ▶ 2:54 Gideon Mann I think GPT-II was like, ah, I don't know, Melanie, you'll correct me. 2 times in the scene
NLP—The Most Important Field of ML // Clement Delangue, Hugging Face (FirstMark's Data Driven NYC)
- ▶ 21:53 Clement Delangue That's why, uh, we have, uh, maybe models that you've heard of, uh, GPT-II, BERT, uh, ExcelNet, uh, all these
Fireside Chat: Mike Volpi, General Partner, Index Ventures (FirstMark's Data Driven NYC)
- ▶ 26:29 Mike Volpi There's some of this BERT and, uh, GPT-II stuff that, that Google has published is, uh, super interesting.
Rebooting AI // Gary Marcus, Robust AI (FirstMark's Data Driven NYC)
- ▶ 12:05 Gary Marcus Um, and so we looked at OpenAI's GPT-II, which is the system some of you have heard of earlier this year, right? 2 times in the scene
- ▶ 34:26 Gary Marcus And some, um, wise-ass from DeepMind recently thought it would be fun to feed it into the problem that I proposed into GP-II.
Building Machines That Can Read and Write // Sean Gourley, Primer (FirstMark's Data Driven NYC)
- ▶ 4:43 Sean Gourley Some of the colleagues out of, um, OpenAI released GPT-II.
- ▶ 12:04 Sean Gourley An example of that is this is GPT-II output.