Liang: Agentic AI will drive a wave of mid-sized distributed data centers
Rodrigo Liang · Inference 101: SambaNova CEO Rodrigo Liang · Sourcery with Molly O'Shea · Jul 17, 2026 · at 11:27
Rodrigo Liang, CEO of SambaNova Systems, explains why agentic AI workflows require distributed, lower-latency data center architectures rather than only centralized mega-facilities.
0:00 / 0:14exact quote · 14.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And I think you're going to see this new wave of companies that are doing distributed data centers, right? So these data centers are mid-sized, right? They're mid-sized, and it's going to be even more important as you go into this agentic world”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Rodrigo Liang
Liang: SambaNova 10kW SN40 rack outperformed 140kW Nvidia GPU racks
“And so by the time we released SN-Forty a couple years ago, it became incredibly popular, because instead of a 130, a 140 kilowatt rack of NVIDIA GPU, we were outperforming them with a 10 kilowatt SN-Forty rack.”
Liang: Groq and Cerebras can only run small models fast
“Or you look at services like Rock Cerebus that run fast, you can only run the small models, right?”
Liang: Nvidia GPUs are a commodity offering very limited cost advantage
“People forget, as much as NVIDIA costs, it's commodity. Right? Because what you offer is the same as what your neighbor offers and your differentiation is, I can save you a little bit of money because maybe I got a discount from NVIDIA, right? Or maybe I got a…”
Liang: SambaNova serves 1.5T parameter models on one rack versus 10-20
“And so with sum it over, that minimum quantum is down to one rack. Right, where if you have other, other service providers, you just run, say, a DeepSeq model, which is now one and a half trillion parameters, just to run that, the minimum for some of the other…”
Liang: Frontier AI models are heading toward 10 trillion parameters
“The new models are heading towards 10 trillion. Even the open source models are already one to two trillion parameter models, and so now you're starting to see these models getting very big because people are looking for accuracy, right?”
Liang predicts data centers will support only three to four AI chips
“As much as these data centers and service providers are heterogeneous, right, they're using different chips, NVIDIA and other chips, it's not going to be a hundred different chips. It might be two or three. Maybe three or four, right? That's as heterogeneous a…”