Sanghi: AI GPU infrastructure is an order of magnitude more complex than traditional cloud
Sharad Sanghi · Can Neysa be India's AI Cloud alternative to AWS, Azure & Google Cloud? | Sharad Sanghi · Apr 11, 2025 · at 16:24
Veteran data center and cloud founder Sharad Sanghi explains the technical hurdles in operating specialized GPU cloud platforms.
0:00 / 0:15exact quote · 15.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I can tell you that the level of complexity with GPUs and with AI infrastructure, given how latency sensitive and how you know, the number of parameters that you have to worry about is much, much an order of magnitude more complex.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sharad Sanghi
Sanghi: Hyperscalers are cookie-cutter and cannot customize solutions
“Hyperscalers have by the, Term hyperscale itself. They have huge scale. They are cookie cutter. They can't, they don't have, they can't customize solutions”
Sanghi: CoreWeave operates with close to 70% gross margins in the US
“So the leader in the space core weave in the U S has close to 70% gross margins.”
Sanghi: India is behind on foundation models but will catch up soon
“I think when it comes to foundational models, maybe we are a little bit behind, but I think we'll catch up soon.”
Sanghi: 2025 will see a major shift toward enterprise AI production workloads
“People are right now still doing experiments and very little is in production, but I think this year will be a shift where we'll see more production AI workloads. I think last year there was you know, more of experiments and less production, but I think this y…”
Sanghi: AI data center rack power density will soon reach 130 kW
“I remember when we started net magic, our average density of rack was like six kilowatts per rack. Then it went to 10 kilowatts per hour, then went to 22 kilowatts per hour. Now it's at 40 kilowatts per hour and very soon it will go to 130 kilowatts per hour.”
Sanghi: Data center total revenue is expected to quadruple in a few years
“Data centers are already growing at very high rates, you know, anywhere from 25 to 30% as per industry standards. They're expecting the data center Total turnover or total revenue of the data centers to, you know, literally quadruple in a few years, right?”