GPT-4

“So there's nothing out there today in open source that is like GPT four, three, five or anthropic cloud quality, right? So there is a, there's one player out in front and that's open AI”

“ChatGPT was a 10 month old model with a little bit of RLHF on top of it. And, you know, like by, you know, admission, like You know, not a beautiful user interface. It was just sort of a way to get something out there because you know, you needed some practice…”

“We've also deployed an internal assistant called Ava so that all of our engineers can leverage the GPT-IV models in a lot of what they're doing, but do that in an assisted way that helps them figure out how to integrate that.”

“We live in a world where we can't count on GPT-IV everywhere. Like we don't have that on classified environments, right?”

“They hadn't even finished the first training run of GPT-IV, but they said, you know, we think it's going to be done in about two weeks, and we think This is going to be the model that really wakes up people to the power of generative AI. We want two reasons wh…”

“So I definitely believe that AIs could operate in a more pure layer. Of logic that then gets converted and mapped back to whatever problem at hand that you have.”

“In order to 10 X or even a hundred X use cases and usages for AI outside of that, there's things that could just be done on existing models today. So you don't need to wait for GPT seven or whatever. You could start with GPT four or GPT 3.5 and add these thing…”

“When I first got access to GBD-IV you know, months before it was publicly accessed, because I was on the OpenAI board, I sat down and said how can I, Reid Hoffman, make money through investing in artificial intelligence? Because I just wanted to try it. And it…”

“And after that, we sort of just bet the company on it.”

“And you could see that if you augment all of them with RAG on, even on the internet, which is data that they were trained on, you can reduce hallucinations significantly up to 50% sometimes.”

“They went from basically starting the company to almost GPT-IV level in less than a year.”

“Like there's, I think we see increasingly interest in open source, but the reasoning abilities are still just like lagging behind Cloud three or GPT four. And I think like for a lot of the applications that it kind of, it probably depends on the types of appli…”

“I think it's very it's very likely at this point that you end this year with a handful of GPT-IV level models, and that some of those are open source, right?”

“The key to the scaling of these large language models and the, you know, these language models in general is the ability to scale data. And I think that one of the fundamental bottlenecks to, you know, what's, what's in the way of us getting from GPT-IV to GPT…”

“JP Morgan's proprietary data set is a 150 petabytes of data. GPT-IV is trained on less than one petabyte. Of data.”

“GPT-IV, I think, as a model, was a little early of a technology for us to have this entire hype wave around, and I think we, you know, the community very quickly discovered all the limitations of GPT-IV... It was probably a few generations too early of a model…”

“Frontier AI research is also basically like completely stopped publishing. You know, the GPD four paper had zero technical details. The Gemini paper had zero technical details on the longer context stuff.”

“I think that what we'll see people doing is kind of composing, this sounds funny, but massive networks, Where maybe each stage in the network will basically be maybe some best of A, best of K component with many, many calls to different language models, you kn…”

“Over the last 18 months or so, the cost of a million tokens going into a GPT-IV equivalent model has basically dropped 240 X.”

“What we've seen is today you can build a model that's as good as GPT-IV in all the things that enterprises might care about. For ten million dollars, twenty million dollars, like just orders of magnitude less than what was spent to develop that model. And so i…”

“Somebody on my team kind of worked out that in the last 18 months we saw a 180 X decrease in cost per token for equivalent level models. 180 X, not 180%, 180 times.”

“It seems like there was this large gap between I log into ChatGPT or I just use GPT-IV from an API or whatever it is, and I try something a couple times versus I'm going to sit there and just hammer on this until it works, right? and I think if you do that …”

“In 20, 24, the cost of GPT-IV equivalent models, if you look at a million tokens, it came down over a hundred X. You know, so many of my team did this analysis to show that.”

“We looked at the cost of a GPT-IV level or equivalent model. We looked at that a year or two ago and basically in 21 months, it went from like 37 bucks for a million tokens to 25 cents. And so, you know, pricing dropped by a 150 X in 21 months.”

“It wasn't until I played with GPT-IV that it became really, really real. So, you know, we, when we got access to it was sort of like a proto-ChatGPT-like interface. And my co-founder Ivan and I both got access, and it was just immediately clear, like, I would …”