Patel: Inference speed matters more than data center location for agents
Dylan Patel · FULL INTERVIEW: Dylan Patel Says We’re Still Underestimating AI · Feb 3, 2026 · at 6:46
Dylan Patel (SemiAnalysis) discusses why Cerebras wafer-scale compute is valuable for agentic workloads like coding assistants.
0:00 / 0:35exact quote · 35.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“You have people thinking like, oh, latency matters in terms of where a data center is. It doesn't matter at all. What matters is, you know, as we've moved from, you know, chat applications, which were like, or search response immediately, chat applications, let's say response takes 10, 20, 30 seconds. You've got agents, you know, I don't know, my cloud codes are working in the background for a long time, right? It doesn't matter where the data center is, but what does matter is that these streams of inference take You know, 30 minutes versus 10 minutes. Versus five minutes, and for a lot of people, I'm fine to spend 10 X the price. On something that completes 10 X faster. And so, so Cerebrus sort of just makes a ton of sense there.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dylan Patel
Patel: Anthropic's $300B revenue target for 2030 is too low
“And when Anthropic says in their funding, like, hey, we're gonna have three hundred billion dollars of revenue by the end of the decade, and it's like, actually I think that number's too low. Because the economic value of what they're gonna create is gonna be …”
Patel: Power is less than 10% of total AI cluster cost
“Power is less than 10% of the cost of the cluster. Right? So, so like, it's that 90% you're not saving anything on.”
Patel: Blackwell GPU failure rates sit at 10%–15% versus Hopper's 5%
“Over time, like, Hopper's now at five percent, but Blackwell's still 10 to 15%. Actually started out higher than that.”
Patel: Nvidia is diversifying chip architectures due to AI uncertainty
“You've got, like, CPX, you've got, like, the standard GPU, and now you've got the Grok chips, and they all fill a different niche, but really it screams, oh crap, we don't really know exactly where AI is going, which I don't think anyone does, right? I mean, i…”
Patel: xAI and Anthropic compute leads bet on space data centers by 2028
“Well, there's a bet, right, between basically the head of compute of XAI and the head of compute of Anthropic. And the bet is, what percentage of worldwide data center capacities in space by the end of 28, and the bar is one percent. And so the XAI guy is like…”