Liang: SambaNova is deploying hardware in metropolitan cities for lower latency
Rodrigo Liang · Inference 101: SambaNova CEO Rodrigo Liang · Sourcery with Molly O'Shea · Jul 17, 2026 · at 13:15
Rodrigo Liang, CEO of SambaNova Systems, discusses the physical deployment strategy of SambaNova's AI inference infrastructure in major urban centers.
0:00 / 0:12exact quote · 12.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And so you're now seeing us coming in and saying, look, we're going to deploy the hardware where the users are in large metropolitan cities. Because that's where business is being run, and so latency is really important, so we're going to deploy that.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Rodrigo Liang
Liang: SambaNova 10kW SN40 rack outperformed 140kW Nvidia GPU racks
“And so by the time we released SN-Forty a couple years ago, it became incredibly popular, because instead of a 130, a 140 kilowatt rack of NVIDIA GPU, we were outperforming them with a 10 kilowatt SN-Forty rack.”
Liang: Groq and Cerebras can only run small models fast
“Or you look at services like Rock Cerebus that run fast, you can only run the small models, right?”
Liang: Nvidia GPUs are a commodity offering very limited cost advantage
“People forget, as much as NVIDIA costs, it's commodity. Right? Because what you offer is the same as what your neighbor offers and your differentiation is, I can save you a little bit of money because maybe I got a discount from NVIDIA, right? Or maybe I got a…”
Liang: SambaNova serves 1.5T parameter models on one rack versus 10-20
“And so with sum it over, that minimum quantum is down to one rack. Right, where if you have other, other service providers, you just run, say, a DeepSeq model, which is now one and a half trillion parameters, just to run that, the minimum for some of the other…”
Liang: Agentic AI will drive a wave of mid-sized distributed data centers
“And I think you're going to see this new wave of companies that are doing distributed data centers, right? So these data centers are mid-sized, right? They're mid-sized, and it's going to be even more important as you go into this agentic world”
Liang: Frontier AI models are heading toward 10 trillion parameters
“The new models are heading towards 10 trillion. Even the open source models are already one to two trillion parameter models, and so now you're starting to see these models getting very big because people are looking for accuracy, right?”