OpenAI API

“So we recently rolled out a change where in the API, like, those models are served, like, 40% faster, and in Codex they're served, like, a quarter fast, 25% faster.”

“Every single model we've released in one of our products gets released in the API.”

“Yes, that's open source, and the model is available in the API, so, so that's what they focus on.”

“We've reached the point where actually the codex model is the most served coding model in the API as well.”

“One thing we talk about internally sometimes is like, what does our end user reach from the API? Like it's actually, it's like really, really, it's really bright. It might even, it's hard because ChatGPT is growing so quickly, but like it, like at some point i…”

“For or like the retention of people building on our API is like surprisingly high especially when people thought you could just kind of swap things around. You might have, you know, like even tools that help you swap things around. But yeah, the stickiness of …”

“The original, I think the original, I don't know, what was it, GPT 3.5 or something, was like a hundred x the cost of GPT-Foro Mini today. In, in the API. So a couple years, you've gone down two orders of magnitude in in cost. For much more intelligence.”

“And when the API becomes generally available, this is going to be trivial. It's literally going to be like, This is your inspiration or like reference ad. These are all the different audiences, just like boom, boom, boom, smash them out and you'll have a hundr…”

“A lot of the companies I see that are using AI in their core product and are, I would call it cheating a little bit. They just integrate with the open AI API and they're not doing much really innovative inside the product with that AI, but they are using it so…”

“The API is actually OpenAI's first product, and the first idea for commercialization, that predates me as well.”

“A lot of the same problems we saw with that early data stack, we're now seeing evolved or in parallel right with the AI stack today. So data reliability, like, is the data reliable? The same question people are asking for large language models, right? Or is it…”

“It's fundamentally the same technology, maybe with a small difference, with reinforcement learning, with human feedback. For ChatGPT, but it's fundamentally the same technology, and the reaction, and the ability to grab people's imagination, and to get them to…”