GPT-4

“So this is gonna sound probably insane to most people who hear it, but I think the GPT technology is under hyped because what we see in GPT-IV specifically as a model, and I'm assuming the same will be true as new models come out in the state of the art advanc…”

“When we got the chance to work at GPT-IV, maybe about six or so months before it was publicly released,”

“Anything you do with those prompts, you can get your own model to do with a little bit more training.”

“OpenAI itself has now enabled distillation internal to its own API. So you can use O-one, you can use even GPT-IV or IV-O to distill it down into a much cheaper model that's internal to them, like GPT-IV, IV-O-Mini. And that's sort of their, you know, lock-in …”

“The other thing I think is interesting about this example is like during the batch before a one came out, diode had tried to do this with GPT four. Oh, and it just flat out didn't work. And then they basically tried the same thing, the same prompts, but fed it…”

“I tried GPT-IV just a couple of days ago, and honestly, I wasn't yet as impressed. It just came back with me with too many questions and actually got the implementation wrong too many times.”

“Because we were so focused on large language models and were researching deeply in this space, we got really early access to GPT-IV. Like summer, 20, 22.”

“You know, we've also had YC companies where, ah, they had something that beat OpenAI, ah, you know, GPT-III.V and they were doing fine-tuning with RL, but then, ah, yeah, GPT-IV and then, ah, GPT-IV came out and, ah, you know, basically blew their fine-tuning …”