Appenzeller: Small distilled models use reasoning to overcome limited memory capacity
Guido Appenzeller · DeepSeek, Reasoning Models, and the Future of LLMs · Mar 5, 2025 · at 1:42
Guido Appenzeller, Andreessen Horowitz (a16z) General Partner, explains how distilled reasoning models like DeepSeek-R1 answer complex queries via test-time reasoning.
0:00 / 0:26exact quote · 26.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“On the right side, we have a distilled version of DeepSeq R-one. So this is a very, very small model. It can't actually answer this directly from memory, but what it does, it starts reasoning. And if you read the text, right, it really starts to hustle. It's trying to think, it's trying to theorize, it questions itself, and, you know, over time hopes that it's going to arrive at the right answer, which in this case, it actually eventually did. So it's very impressive that with these small models, we can actually get to these very high, high quality results.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Guido Appenzeller
Appenzeller: Intel-Nvidia partnership means AMD is 'fucked'
“I think AMD is fucked, right? I mean, they're, you're just, If your two arch nemesis suddenly team up, that's the worst possible news you can have, right? They were already struggling, right? Their cards are good, their software stack is not, right? They were …”
Appenzeller: Capital moats in AI are shallow speed bumps
“If that assumption is true, I think this means that the moat that's created by these large capital investments is actually not particularly deep, right? It's more of a speed bump than Then, you know, something that prevents new entrants.”
Appenzeller: Intel lacks competitive AI chips and its Gaudi effort is done
“They can't, they don't have anything competitive, right? There was the Gaudi effort that's more or less done, right? There was the internal graphics chips, which never competed really at the high end, right?”
Appenzeller: Intel's customer concentration allowed hyperscalers to push down prices
“One of the biggest problems we had was that our customer base sucked, right? I mean, we were selling to, most of the chips went to the large hyperscalers, you know, which they're way too concentrated, and they build their own chips, and so you can push down yo…”
Appenzeller: High compute costs will force AI into usage-based pricing
“It'll push more and more to, I think, just usage based pricing, right? I think if you have a, if you have an underlying commodity that you're reselling to some degree that has, that is that large a part of your cost of goods, right? You need to go to usage bas…”
Appenzeller: Novel coding lacking AI training data is only 0.01% of development
“I think the good news is that is 0.01% of all software development, right, for the, I don't know, you know, 100,000 ERP system implementation or so, right, that we have tons of training data, and I think these tools can be very, very powerful.”