Zhang: Enterprises must evaluate AI on holistic success rates, not zero mistakes
Jesse Zhang · The Future of AI Agents | Jesse Zhang Interview · Invest Like The Best · Oct 6, 2025 · at 1:07:01
Jesse Zhang, CEO of Decagon AI, explains why enterprise adoption of AI agents encounters friction compared to human baseline performance.
0:00 / 0:29exact quote · 29.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“There's the Waymo effect that often happens where It will be objectively just way better than human drivers, and human drivers make a lot of mistakes, but because we're investing in new technology, the bar is a lot higher, so it has to be near perfect. So there's that dynamic that kind of needs to adjust in some folks' mind, where instead of evaluating AI in a way where you're just trying to find mistakes, you're evaluating holistically, looking at the sort of success rate, and then if you can kind of frame it that way, well, the success rate is going to be way higher than humans, because again, humans are not perfect, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Jesse Zhang
Fears of AI customer support layoffs are overblown due to natural attrition
“I think it's a little bit overblown of like, oh, AI is replacing jobs and so on. I think most of, even the BPO as we talked to not really that concerned because what typically happens anyways, is that there's already very high turnover in these, BPO's cause li…”
People falsely claim to be Decagon customers on investor expert network calls
“We have people who had said that they've used us, and we literally never heard of them.”
Zhang: AI application startups should ignore margins and prioritize market share
“Like right now, I would argue that if you're building an application, you're Margin shouldn't really matter that much. Like, people will often sort of critique the coding agents like they're hemorrhaging money. Yeah, but, you know, again, things are improving …”
Frontier AI labs will move toward applications due to API commoditization
“That's why I think the open AI's of the world will continue to move towards applications because it's quite hard for them to make money longterm on like their API, for example, because There's like such high competition, all the labs are building, and it's lik…”
Forward-deployed engineering models require a minimum customer deal size of $1 million
“Oh, like probably a million.”
Experienced founders warned Zhang that AI customer support was too obvious
“Essentially what everyone told us, including like, you know, very smart, older founders that we knew and so on was that yeah, this is like excuse case, like super obvious. There's probably just going to be incumbents that are just tacking onto the product. And…”