Wang: AI model inference costs dropped 10x year-over-year
Sarah Wang · The State of AI: Growth, Fragmentation, and the Next Wave · Aug 22, 2025 · at 6:03
Sarah Wang, General Partner at a16z, discusses AI unit economics and foundation model competition at the 2025 a16z LP Summit.
0:00 / 0:04exact quote · 4.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And in fact, I think model inference costs have gone down 10 X year over year.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sarah Wang
Wang: All 24 surveyed a16z startups use Cursor, driving up to 10x productivity
“This year I was pretty blown away by the answers that we got. They spanned from, call it, 30 to 50% on the low end in terms of productivity gains to, I kid you not, one CTO told us that he had seen a 10 X productivity lift from himself and his team. They were …”
Wang: AI offers a 10x UX jump threatening enterprise systems of record
“This is the first time that we've seen a genuine threat to that. And that's because the distance between intent and execution is collapsing. And that's creating not a 20 to 50% better experience for the user, but how you get to that magical TEDx.”
Sarah Wang: AI SRE startups are beating legacy platforms like Datadog
“That's why we're starting to see even agents built on top of classic, iconic platforms like Datadog Lose to some of the new AISRE companies, like a resolve or a traversal.”
Wang: Dynamic AI agent layer will overtake systems of record in 2026
“Twenty-twenty-six is going to be the year that the dynamic agent layer overtakes the system of record.”
Wang: SaaS incumbents face classic innovator's dilemma in AI race
“Every SaaS company under the sun has launched an AI product. They're not just sitting on their hands, and you'd think that they'd have a huge advantage given distribution, but we're just seeing classic innovators dilemma.”
Wang: Specialized AI apps win in complex, data-integrated workflows
“You have complex workflows and a ton of customer data where deep integrations actually are necessary to get that last last mile value for the customer. This is where the specialized AI apps are sort of crushing, crushing any either foundation model layer or ot…”