reasoning models
also referred to as: reasoning model
9 statements across 8 episodes · 4 bullish · 3 bearish · 8 people on the record · first statement Feb 27, 2025 by Mark Chen · across every show →
Everything said about reasoning models, oldest first
Feb 27, 2025 bullish
Chen: GPT-4.5 outshines reasoning models like o1 in creative writing
“And, you know, we find that in a lot of areas like creative writing, for instance
Again, this is stuff that we want to test over the next one or two months but we find that there are areas like creative writing where this model outshines reasoning models.”
Feb 27, 2025
Chen: AI models cannot learn reasoning from scratch without pre-trained knowledge
“You need knowledge in order to build reasoning on top of it.
Right.
a model can't kind of go in blind and just learn reasoning from scratch.
So we find these two paradigms to be fairly complementary and we think, you know, they have feedback loops on each oth…”
Mar 28, 2025 negative
Hendrycks: Recent AI reasoning models score in 90th percentile on wet-lab guidance
“We are finding that with the most recent reasoning models quite unlike the models from two years ago, like the initial GPT-IV, the most recent reasoning models are getting around 90th percentile compared to these expert level virologists in their area of exper…”
Apr 4, 2025 bullish
Suleyman: Reasoning models taking desktop action will be cheap and abundant within 15 years
“That's the transition that's going to happen over the next 15 years is that it is going to be a cheap and basically abundant resource to have these reasoning models that can take action in your workplace, that can orchestrate your apps and get things done for …”
Apr 23, 2025 bullish
Patel: Generating pre-answer reasoning tokens yields superior AI performance
“Models now will think for some time before they answer. And this enables much better performance on all sorts of tasks, whether it be coding or math or understanding science or understanding complex Social dilemmas, right? All sorts of different topics they're…”
May 7, 2025 bearish
Marcus: 'Reasoning' AI models only mimic patterns without genuine abstractions
“Now, the reason I wouldn't call them reasoning models, though you're right that many people do, is what I think they're doing is basically copying patterns of human reasoning. They're getting data about how humans reason certain things, but the depth of reason…”
Aug 8, 2025 neutral
Lightcap: Most free ChatGPT users haven't used reasoning models yet
“Most of them have actually not experienced the power of the reasoning models. They mostly are using GPT-IV-O and, you know, they mostly are kind of using it for this very kind of you know, turn-based kind of like very quick you know, back and forth, almost sea…”
Feb 6, 2026 negative
Pineau: Reasoning models fail at multi-tier hierarchical planning
“That's the part that the reasoning models don't do. They do really well at like one level of granularity... But the going back and forth between different levels of sort of resolution of action, it's really hard. So on the technical terms, we call it hierarchi…”