Appenzeller: AI output generation layers will delaminate from reasoning models
Guido Appenzeller · Who's Coding Now? - AI and the Future of Software Development · May 16, 2025 · at 41:49
Guido Appenzeller, a16z Infra partner, discusses the future technical architecture of AI reasoning models and output formatting interfaces.
0:00 / 0:31exact quote · 31.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Long-term, I actually wonder if the, like for reasoning model, where a lot of the thinking sort of happens internally, if the model is generating the user facing machine facing output, it's going to be a different model from the model doing the reasoning, if that makes sense, right? So the, you know, I like a really a chatty, chatty model or somebody else you know, wants a more tourist model, or if you want to have generate JSON output, You know, one, have yet another model. So you could see some of the model output layer delaminating at some point from the reasoning layer.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Guido Appenzeller
Appenzeller: Intel-Nvidia partnership means AMD is 'fucked'
“I think AMD is fucked, right? I mean, they're, you're just, If your two arch nemesis suddenly team up, that's the worst possible news you can have, right? They were already struggling, right? Their cards are good, their software stack is not, right? They were …”
Appenzeller: Capital moats in AI are shallow speed bumps
“If that assumption is true, I think this means that the moat that's created by these large capital investments is actually not particularly deep, right? It's more of a speed bump than Then, you know, something that prevents new entrants.”
Appenzeller: Intel lacks competitive AI chips and its Gaudi effort is done
“They can't, they don't have anything competitive, right? There was the Gaudi effort that's more or less done, right? There was the internal graphics chips, which never competed really at the high end, right?”
Appenzeller: Intel's customer concentration allowed hyperscalers to push down prices
“One of the biggest problems we had was that our customer base sucked, right? I mean, we were selling to, most of the chips went to the large hyperscalers, you know, which they're way too concentrated, and they build their own chips, and so you can push down yo…”
Appenzeller: High compute costs will force AI into usage-based pricing
“It'll push more and more to, I think, just usage based pricing, right? I think if you have a, if you have an underlying commodity that you're reselling to some degree that has, that is that large a part of your cost of goods, right? You need to go to usage bas…”
Appenzeller: Novel coding lacking AI training data is only 0.01% of development
“I think the good news is that is 0.01% of all software development, right, for the, I don't know, you know, 100,000 ERP system implementation or so, right, that we have tons of training data, and I think these tools can be very, very powerful.”