Lloyd: Upgrading Anthropic models gave Warp only modest SWE-bench gains
Zach Lloyd · No Priors Ep. 137 | With Warp Co-Founder & CEO Zach Lloyd · Oct 23, 2025 · at 24:47
Zach Lloyd, CEO of Warp, discusses diminishing returns and performance jumps across Anthropic model generations on SWE-bench.
0:00 / 0:23exact quote · 23.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Like, if you take, like, Sonnet four to four five, and we're big partners with Anthropic, they have great models, like, that was, like, a few percentage point increase on Sweebench for us. And we invest, you know, we've invested a decent amount to be one of the top agents on Sweebench, and when we went from three seven to four, it was a much more significant boost.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Zach Lloyd
Lloyd: Engineering expertise is not devalued and is more important than ever
“What I really don't think though is like engineering expertise is going to become devalued. So I think it's actually in the short term, at least it's more important to know what you're doing as an engineer than it ever has been.”
Lloyd: Agentic code review will be bundled into broader dev platforms
“Some things that are vertical right now, like, I actually, I think will, like, for instance, like agentic code review. Take that. To me, that's Should be part of a like holistic agentic development platform, not so much a standalone thing.”
Lloyd: OpenAI Will Subsume Best ChatGPT Apps Using Platform Data
“I don't know if you saw OpenAI Dev Day yesterday, but they're clearly doing this platform play within ChatGPT now where it's like you have apps within ChatGPT. I'm sure they'll use that data to Sort of subsume or take over whatever the best first party integra…”
Lloyd: Human brains don't use next-token prediction; another AI unlock is coming
“Something I'm always thinking about is like, is this how our brains are working? Are we doing next
Token prediction, and I don't think so. Like, I think that there's gonna be some further AI unlock.”