GPT-3

“Two years ago, I remember being shocked at GPT-III when it was released, because it was just so, I'm an old NLP guy, and it was so vastly better than anything that, that we could build for decades.”

“The tool that we had was good for 2016 through 20 19 deep learning, but as of GPT three deep learning, it wasn't good enough, and so we had to upgrade to this kind of new paradigm that we introduced.”

“Fine tuning is the technology that got from a research project in 2020 called GPT-III and turned that into ChatGPT, a billion dollar app, right?”

“I think for something like a GPD three level model, it's a 10,000 X speed up in efficiency while losing nearly not much at all in accuracy.”

“So we, we've always had our own technology down to the LLM. There was a very brief period, literally like three months, where we, for some of our apps, used GPT-III because it was just so much better.”

“When GPT-III came out, I think we were one of the first companies to build anything on top of it. The first thing we built was like, you highlight a piece of code and you explain it.”

“It was really hard to build anything like that with GPT-III. It was expensive. It was slow.”

“When we trained GPT-IV, we were pretty underwhelmed internally, and then there was a lot of moments, oh, we trained this small, we spent a lot of money on it, and it's kind of like, you know, pretty dumb, at least, like, you know, we have GPT-IV, GPT-III alrea…”