The Ledger, every show

“I think right now expectations are extremely high. Reality is still pretty bad, honestly. These models are not that good.”

“Our scaling laws still hold. Empirically, there's no reason to believe that there's any kind of diminishing return on pre-training and on post-training.”

“Intelligence really is a function of how much time the model is going to be thinking, and so depending on how much you want to allocate thinking time to a problem, you're going to get a better answer. Typically, the longer it thinks the better an answer it can…”

“You know, the O series of models, which were kind of the previous reasoning models were really just the beginning of us starting to explore what's possible in that post-training regime. And I think that's going to be kind of the dominant theme here for the nex…”

“And so I do, I think we're at a system that I would call AGI. No. But I think we see, we start to see the traces and the pieces of that overall system for generalized learning start to come together in models like GPT-V and I suspect suspect in its successors.”

“I think you could pause AI progress right here for 10 years, and you'd still have about a decade worth of new products to get built, of new ways that people figure out how to use the models even at a GPT-V level model in interesting products and interesting pr…”

“GBD-V, I think depends on how you measure it, but it's, you know, four to five times more accurate than its predecessors.”

“I mentioned companies like Cursor, JetBrains, Windsurf you know, Cognition and others that we work with who anecdotally are all you know, have all said that GPT-V now feels like the most capable coding model, whether that's in an interactive coding environment…”

“I think very quickly expectations will start to come down as people come into contact with today's models, but then very quickly also these models will get really, really good, and you'll see this inversion of expectations reality where all of a sudden then ex…”

“I think people though criminally underrate how important it is actually and how much like return you really get on just giving people access to the technology. And that there's this kind of, because you can'queries quite quantify exactly how it works, but like…”

“A lot of companies think it's static, so a lot of companies think GPT-IV is the best the models will ever get. That's understandable. Every technology they've ever had to adopt has been relatively static.”

“I think it's how consistently the scaling of models has worked. It still breaks my brain. Like I don't, maybe I've been, if we've, I've watched the same trend line for six years now, but I still find it incredible that you can make these models bigger and they…”

“GPT-V is it's our next generation flagship model. It does something really interesting, which is it actually combines into one model the ability to dynamically choose whether to think hard about a problem and reason about it to give you an answer or not.”

“GPT-V abstracts all of that, so it makes that decision for you and it's actually a smarter model, so you're gonna get a better answer in all cases, regardless of whether you're using the thinking mode or not and it's vastly improved on things like writing, cod…”

“Even though if you don't allow any thinking time you still get a typically net better answer than you would for one of our non-thinking models like GPT-IV-I.”

“It scores better on things like Sweebench. It scores better on all the kind of academic evals that we put it through. This one in particular, we actually made a real emphasis to have it score better on certain health benchmarks. So It's better at medical reaso…”

“And that continues to hold true, but we now have this kind of other category of training, which is post-training and being able to use test time compute in more interesting ways than we used to as almost kind of a second stage of training. And so we think that…”

“So using tools, for example, is something that really thinks really important for overall intelligence, GPT two and three couldn't really do that as well. GPT-IV could do it in a more nascent way. And now GPT-V, you get that baked in with the benefit of these …”

“And so that's for us, I think the real world benchmark is increasingly becoming important. As a sign of intelligence relative to the academic benchmarks.”

“I don't think it'll replace GPs, but what I think it helps people do is become, have more agency in their journey a little bit more control over their, you know, the process of managing care.”

“Ask the company whether a hundred X improvement in the model is something they're excited about. It's actually, we can tell pretty well because we know the companies that come to us saying, we want the next model. When is it coming out? When is it coming out? …”

“Really that, that, like, company changing ideas actually, by and large, come from places that are not, not those hires.”

“As the models get smarter, they almost demand more from a product building perspective in terms of how you actually plug them into the system. I always kind of roughly analogize it to like, you could have a really, really smart intern. And you know, At the end…”

“And we're bringing GPT-V to our free tier”

“And so we expect that like for, yeah, for the average user, it will feel dramatically different. Maybe for the kind of upper echelon of power user, it may not feel as different.”

“In many ways, I always kind of say we haven't yet seen the ChatGPT moment, I think, in business for AI.”

“We've worked with large enterprises and small startups and the entire spectrum in between on testing these models and GPT-V specifically before release. And we get a lot of feedback from companies like Uber and Amgen and Harvey and Cursor lovable you know JetB…”

“In OpenAI's history, every time we've cut costs, we've seen typically some corresponding increase in consumption that usually outweighs the cost cut.”

“For as long as that trend holds, we will continue to cut costs on models.”

“I asked probably 25 people if they would want to be CFO of OpenAI, which at the time was just a small kind of non, sleepy non-profit, and I went over 25, and honest to God, the reason I'm here is because I was so embarrassed to come back Like, over 25 that I s…”

“Well, we have real budgets and that'll help.”

“It caught us somewhat by surprise how important the technology is and is going to be in creative industries, for example relative to more knowledge based industries or relative to even more industrial industries.”

“We were doing robotics really early on. And so I was preparing for a world where we were working with robotics companies and building robots and working with gaming companies and building agents. And we've gone completely the other way.”

“Most of them have actually not experienced the power of the reasoning models. They mostly are using GPT-IV-O and, you know, they mostly are kind of using it for this very kind of you know, turn-based kind of like very quick you know, back and forth, almost sea…”

“We focused on health a lot with this release because that was one of the consistently common things that we heard from people as a starting point for how they've used powerful AI was in, when they're navigating a health journey. And so we really wanted to make…”