OpenAI, every mention
63 scenes (2023), the whole family · ← back to OpenAI
tap a year for its mentions
every year 2023 anyone David Rosenthal 108Ben Gilbert 76Steve Ballmer 2Emily Chang 2Jensen Huang 1
Verbatim, from the transcripts: the passages where OpenAI comes up
Holiday Special 2023 (Audio) · Acquired
- ▶ 33:49 David Rosenthal Added arguably almost all of the most important AI companies in the world this year, including OpenAI, which uses Statsig for ChatGPT, Microsoft, Atlassian, Anthropic, many, many others, along of course with regular old companies like…
- ▶ 1:14:01 Ben Gilbert For example, the dozens of requests we got two weeks ago or three weeks ago for OpenAI after the boardroom drama.
- ▶ 1:20:03 Ben Gilbert And like, does anyone have the story right on what happened in the OpenAI boardroom right now?
NVIDIA CEO Jensen Huang · Acquired
- ▶ 18:10 David Rosenthal And obviously that led to lots of things, including open AI a couple of years later.
- ▶ 20:30 David Rosenthal When OpenAI was founded in, yeah, I mean, that was such an important moment that's obvious today now, but at the time, I, I think most people, even people in tech were like,
- ▶ 21:12 Jensen Huang Uh, we have, we have some great employees today that were there in the beginning, and I knew that they needed this amazing computer that we were building, and we're building the first version of the DGX, which, you know, today when you see…
- ▶ 26:37 David Rosenthal And surprise, surprise, a ton of AI companies are now using Statsig to improve and deploy their models, including OpenAI and Anthropic.
- ▶ 38:15 David Rosenthal Rewind to 20 15 and open AI.
- ▶ 38:22 David Rosenthal You wouldn't be powering open AI right now.
Nvidia Part III: The Dawn of the AI Era (2022-2023) (Audio) · Acquired
- ▶ 2:35 Ben Gilbert First, with OpenAI's ChatGPT, which became the fastest app in history to a hundred million active users, and then quickly followed by Microsoft, Google, and seemingly every other company.
- ▶ 14:42 David Rosenthal OpenAI.
- ▶ 20:04 Ben Gilbert The founding of OpenAI was motivated by the desire to find AGI or Artificial General Intelligence first before the big tech companies did.
- ▶ 20:22 Ben Gilbert But the big idea at OpenAI's founding was whoever figures out and finds AGI first will be so big and so powerful so quickly they'll have an immense amount of control.
- ▶ 20:56 Ben Gilbert But it does actually just show, like, where the seeds of OpenAI come from.
- ▶ 23:07 David Rosenthal OpenAI.
- ▶ 23:21 Ben Gilbert And before we talk about what OpenAI would go on to do in its first chapter, which is quite different than today, this is a great time to tell you about one of our very favorite companies and actually the perfect fit for this episode,…
- ▶ 25:53 Ben Gilbert Okay, so David, OpenAI is formed.
- ▶ 27:12 Ben Gilbert So in 2015, Andre Karpathy, who was then at OpenAI and went on to lead AI for Tesla and is actually now back at OpenAI, writes this seminal blog post called The Unreasonable Effectiveness of Neural Networks.
- ▶ 28:36 Ben Gilbert This is two years before the Transformer, while Karpathy is at OpenAI.
- ▶ 31:12 Ben Gilbert Just left, two years before, to start OpenAI.
- ▶ 35:35 David Rosenthal So Google obviously knows how important this is, and there's like a year where Google's AI work, even though Ilya has left and OpenAI is a thing now,
- ▶ 36:22 David Rosenthal OpenAI and everyone else, though, they haven't adopted Transformers yet.
- ▶ 36:26 David Rosenthal They're kind of stuck in the past, and they're still doing
- ▶ 36:30 David Rosenthal These really researchy computer vision projects, so, like, this is when they build a bot to play Dota II, Defense of the Agents II, the video game.
- ▶ 36:38 Ben Gilbert And super impressive stuff, like, they beat the best Dota players in the world at Dota by literally just consuming computer vision, like, consuming screenshots and inferring from there, and that's a really hard problem, because Dota II is…
- ▶ 37:06 Ben Gilbert I mean, they were also doing stuff like, uh, Universe, which was the.
- ▶ 37:06 Ben Gilbert I mean, they were also doing stuff like, uh, Universe, which was the.
- ▶ 37:14 Ben Gilbert You don't really hear anything about that anymore, but they built this whole thing.
- ▶ 37:36 David Rosenthal They weren't doing anything approaching GPT at this point in time.
- ▶ 37:43 David Rosenthal Now, one thing I do want to say in defense of OpenAI and everybody else in the field at the time, they didn't just have their heads in the sand.
- ▶ 39:57 Ben Gilbert In GPT-I, the first OpenAI model, this generative pre-trained transformer model, GPT, it used unsupervised pre-training, which basically meant that as it was consuming this corpus of language,
- ▶ 41:34 David Rosenthal GPT-III had a hundred and seventy five billion, and GPT-IV, OpenAI hasn't announced, but it's rumored that it has about 1.7 trillion parameters that it was trained on.
- ▶ 43:05 David Rosenthal So, in defense of OpenAI, they knew all this, but the amount of money that you would have to spend to buy GPUs or to rent GPUs in the cloud
- ▶ 44:11 David Rosenthal So with this, it starts to look like maybe this whole open AI boondoggle didn't actually accomplish anything, and the world's AI resources are more than ever just locked back into Google.
- ▶ 44:23 David Rosenthal So in 2018, Elon gets super frustrated by all this, basically throws a hissy fit and quits and pieces out of OpenAI.
- ▶ 44:44 David Rosenthal But whatever happened, this turns out to be a major catalyst for the rest of the OpenAI team and truly a
- ▶ 45:05 Ben Gilbert The author says, That fall, it became even more apparent to some people at OpenAI that the costs of becoming a cutting-edge AI company were going to go up.
- ▶ 45:23 Ben Gilbert OpenAI made a big decision to pivot toward these transformer models.
- ▶ 45:27 Ben Gilbert On March 1120 19, OpenAI announced it was creating a for-profit entity so it could raise enough money to pay for all the compute power necessary to pursue the most ambitious AI models.
- ▶ 45:38 Ben Gilbert We want to increase our ability to raise capital while still serving our mission, and no pre-existing legal structure that we know of strikes the right balance, the company wrote at the time.
- ▶ 45:47 Ben Gilbert OpenAI said it was capping profits for investors, with any excess going back to the original nonprofit.
- ▶ 45:53 Ben Gilbert Less than six months later, OpenAI took a one billion dollar investment from Microsoft.
- ▶ 46:18 David Rosenthal On the other hand, knowing this history now, this was kind of the only path they had.
- ▶ 46:25 David Rosenthal They had to raise money to get the computing resources to compete with Google.
- ▶ 46:35 Ben Gilbert And their opinion at the time of why they're doing this is, basically, this is gonna be super expensive.
- ▶ 46:57 David Rosenthal So, 2019, they do the conversion to a for-profit company.
- ▶ 47:00 David Rosenthal Microsoft invests a billion dollars, as you say, and becomes the exclusive cloud provider for OpenAI, which is going to become highly relevant here for NVIDIA.
- ▶ 47:26 David Rosenthal Microsoft invests another two billion dollars in OpenAI.
- ▶ 47:30 David Rosenthal And then, of course, this all leads to November 30th, twenty-twenty-two, in Jensen's words, the AI heard around the world, OpenAI comes out with chat GPT.
- ▶ 47:46 David Rosenthal In January, twenty-twenty-three, this year, Microsoft invests another ten billion dollars in OpenAI, announces they're integrating GPT into all of their products, and then in May of this year, GPT-IV comes out.
- ▶ 48:03 David Rosenthal We eventually need to go do a whole nother episode about all the details here of OpenAI and Microsoft.
- ▶ 48:59 Ben Gilbert So far I'm thinking, so this is like the OpenAI and Microsoft episode?
- ▶ 49:18 Ben Gilbert NVIDIA, OpenAI, Google, etc.
- ▶ 49:26 Ben Gilbert A ton of big AI companies, OpenAI, Anthropic, Character AI, rely on Statsig to test, deploy, and improve their models and applications.
- ▶ 1:33:39 Ben Gilbert And there's pretty good evidence, I mean, ChatGPT made it so OpenAI is rumored to be doing over a billion dollar run rate now.
- ▶ 2:22:17 David Rosenthal Microsoft is the exclusive cloud infrastructure provider for OpenAI, which runs, as far as we know, solely on NVIDIA infrastructure, but they buy it all through Microsoft.
- ▶ 2:41:01 Ben Gilbert And as we've mentioned, OpenAI is rumored to be doing over a billion dollars in recurring revenue on ChatGPT.
Porsche (with Doug DeMuro) · Acquired
- ▶ 2:34:18 David Rosenthal They are now doing OpenAI, Airtable, Scale.
Lockheed Martin (Audio) · Acquired
- ▶ 3:34:28 David Rosenthal It's particularly thought provoking right now in our era of, you know, open AI and GPT and generative AI and all that.
Spotify CEO Daniel Ek · Acquired
- ▶ 16:52 Ben Gilbert Companies like Notion, Brex, OpenAI, Vanta, Vercel, Cruise, Univision, and more all use Statsig to increase their product velocity.
- ▶ 21:58 David Rosenthal They use OpenAI too.
Benchmark’s Mitch Lasky and Blake Robbins on The Art of Business in Gaming · Acquired
- ▶ 23:54 Ben Gilbert Customers include Notion, Brex, OpenAI, Flipkart, Figma, Microsoft, Cruise Automation.
- ▶ 2:06:28 David Rosenthal I was like, well, I'm pretty sure OpenAI does that.