Reasoning

“Unlimited tokens, I believe, means unlimited reasoning.”

“We wouldn't, for example, go into what I think will happen in a lot of those cases, like very deeply into reasoning version of those use cases where you maybe need to like the multi-touch a lot of complex, a lot of like, Financial analysis of, like, is, like, …”

“So the way I think about it is we've had four fundamental breakthroughs in functionality, LLMs, reasoning agents and then and then now RSI and they're all actually working.”

“The transformer moment for reasoning and choosing action and being able to plan at different levels of granularity. We're still far away from doing that.”

“And I think we all, you know, kind of, I think assume that AI now is going to get really good at reasoning. In, in any domain in which there are verifiable answers, and so that, you know, that's going to include, like, many very important domains.”

“So I think the actual, like, technical definition of reasoning is making models better with thinking and post-training. Ok? Yeah. So basically, like, RL-ing the model to think better.”

“Reasoning is the biggest paradigm shift in AI architecture since the transformer.”

“Turing's the world's leading research accelerator, working with all of these frontier labs to advance them along I would say the four pillars of superintelligence which is multimodality, reasoning, tool use, and coding. If you solve these four things, you will…”

“Reasoning is core to this ability to operate over a long horizon, because, you know, you imagine kind of yourself solving a math problem, where you try an approach, it doesn't work, and, you know, you have to think about, you know, what, what's the next approa…”

“I think the problem has been that people underestimate how many things are truly needed to automate human labor, and so they think, like, we've got reasoning, and now that we've got reasoning, we've, like, this is what it takes to take over a job, and I think,…”

“I think one of the more, more interesting things is that you have convergence not just on capability, but also in the, like, product surface areas. Like, most people have search, they have a research product they have reasoning in the models.”

“When we are again talking about things like agents and reasoning and whatnot, I think a lot of the things are probably done on a small scale in the RL literature, in games and whatnot, and a lot of those ideas would be relevant again now.”

“If you want reasoning to emerge in a model, it's good for you to, like, make sure you have YouTube transcripts of video like lectures MIT lectures, Stanford lectures and textbooks, like where you actually have problems, where it's not just a problem, but the s…”

“Ultimately, the two things that could really, very much shake the industry, the chip industry, in my opinion, is our agents and reasoning.”

“What models are still are today is they're like, they're sort of like completion engines, right? That's how LMs are trained. The sort of auto aggressive models where they try to predict the next token. They're still next token prediction machines. Reasoning is…”

“If it's text, they will regurgitate solutions to puzzles. They will, you know, give you answers to questions you may have. It's mostly retrieval. There's a very tiny bit of reasoning, but really not much and that's an important limitation.”

“There must be a concept of fast thinking, and slow thinking, and reasoning, and reflection, and iteration, and simulation, and all that and that now it's coming in.”

“If you build your system in a way that Kind of assumes LLMs will get better at reasoning and get better at sort of agentic tasks in the LLM itself. Then I think you will build a more durable system.”

“But I think pure model scaling does not deliver solutions to reasoning.”

“Just because something is able to articulate its reason for doing, for getting to an answer, doesn't mean that it is necessarily reasoning.”

“Within the world's languages and text, there's a fair amount of reasoning that's encoded in it, and we describe a lot of reasoning things, and so if you were To say that a few step reasoning is somehow learnable from just reading things. I wouldn't be surprise…”

“This kind of token by token generation we're doing now is not an amazing format for reasoning because you have to like linearly, like do one, say one thing at a time. So it's not really good for like making plans or comparing versions. I think to get a really …”

“They are able to do this task extremely well. And the only way to do that is to have gotten better at under, you know, some form of reasoning and some form of knowledge.”

“When you're emotionally lit up, it's like your brain is shaking, and it shuts down the prefrontal cortex. It shuts down your ability to reason in the same way that a pinball machine just won't work anymore.”