Reasoning models

“And so this, the performance improvements we'll get out of these models is, is humongous, right? In, in the coming, you know, six months to a year in certain benchmarks where you have functional verifiers.”

“Yes, the queries are expensive, but they're nothing close to the human, right? And so each level of productivity gain I get each level of capabilities jump is a whole new class of tasks that it can do And therefore I can charge for that. Right. So this is the …”

“Like you can have the best computers and chips and biggest cluster in the world. But if you don't get the architecture right around your reasoning model and the other guy does, they're probably going to win.”

“We were showing this chain of thought as it was streaming out of the model and the model swore and said, like, oh, damn it, may have to adjust, because it realized it had made a mistake in the puzzle. And the fact that it did that, But in particular, the fact …”

“When you look at reasoning in ChatGPT today, it's irrelevant to a very small group of people. It's relevant for the people who are trying to get the most out of ChatGPT, but I fundamentally believe that reasoning, it's transformative”