reasoning
2 statements across 2 episodes · 1 bullish · 1 bearish · 2 people on the record · first statement Nov 27, 2024 by Yann LeCun · across every show →
Everything said about reasoning, oldest first
Nov 27, 2024 negative
LLMs primarily perform data retrieval and possess very little actual reasoning
“If it's text, they will regurgitate solutions to puzzles. They will, you know, give you answers to questions you may have. It's mostly retrieval. There's a very tiny bit of reasoning, but really not much and that's an important limitation.”
Mar 23, 2025 positive
Srinivas: AI model reasoning requires training on step-by-step lecture and textbook solutions
“If you want reasoning to emerge in a model, it's good for you to, like, make sure you have YouTube transcripts of video like lectures MIT lectures, Stanford lectures and textbooks, like where you actually have problems, where it's not just a problem, but the s…”