Jul 16, 2026 · 44m · mad
OpenAI’s Compute Chief: We Can’t Build Fast Enough | Sachin Katti
0:00 / 0:00
▶ Watch on YouTube →
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
In this episode of The MAD Podcast, OpenAI's Head of Compute Infrastructure Sachin Katti discusses the massive physical, financial, and technological engineering required to build and power gigawatt-scale AI data centers. He details OpenAI's multi-cloud strategy, custom silicon co-design, energy grid integration, and the physical constraints facing global AI deployment.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Matt holds 29.9% of the talking time here. How this is scored →
Matt as informed peer 3.7 Guest teaching 5.0 Guest disagreement 1.8 Matt pushing back 1.7
speaking balance: gold is Matt, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 17:17 Rejecting overbuilding concerns
Sachin directly rejects the host's framing of potential overbuilding risk, clarifying that demand far outstrips supply and that physical supply chain delays are his actual operational paranoia.
Hardest push from Matt ▶ 14:59 Challenging overbuilding and demand lagMatt directly challenges Sachin on the risk of overbuilding compute infrastructure, pressing on the inherent delay between constructing physical datacenters and actual demand realization.
Biggest teaching moment ▶ 14:16 Educating on inference versus trainingSachin reframes the host's clear-cut separation between training and inference workloads, explaining that synthetic data generation, post-training, and test-time compute mean much of modern training is fundamentally inference.
Matt holds his own ▶ 28:05 Detailing multi-billion dollar compute ecosystemMatt demonstrates notable expertise by citing specific deal figures, including a $20 billion arrangement with Cerebras, and pressing Sachin on how Stargate fits into OpenAI's broader partner landscape.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Matt as informed peer | Guest teaching | Guest disagreement | Matt pushing back | Why |
|---|---|---|---|---|---|---|
| Historic Scale and Economics of AI Infrastructure | 4 | 3 | 1 | 1 | Matt cites specific industry spend metrics like $50 billion for OpenAI and $700 billion across AI compute. Sachin confirms the scale of investments and notes the rapid pace of decision-making required inside OpenAI. | |
| OpenAI's Evolution Into Direct Infrastructure Construction | 3 | 5 | 2 | 2 | Matt asks if OpenAI building datacenters represents a corporate pivot or new line of business. Sachin reframes this as developing a new organizational muscle, explaining the physical reality of liquid-cooled datacenters converting electrons to tokens. | |
| Power Grid Integration, On-Site Energy, and Nuclear Energy | 4 | 5 | 1 | 1 | Matt connects their Paris location to France's nuclear infrastructure and asks about datacenter power sources. Sachin explains behind-the-meter gas generation and OpenAI's commitments to fund local grid generation and transmission. | |
| OpenAI's Custom Silicon and the Jalapeño Inference Chip | 4 | 6 | 2 | 2 | Matt prompts Sachin on the strategy behind custom silicon like Jalapeno and whether inference compute now dominates training. Sachin educates Matt on tokens-per-watt efficiency and reframes how post-training synthetic generation blurs the line between training and inference. | |
| Overbuilding Risks vs. Physical Supply Chain Constraints | 4 | 6 | 4 | 3 | Matt pushes on the potential risk of datacenter overbuilding due to long construction lead times. Sachin firmly counters that demand far outstrips supply and clarifies that his main paranoia is physical supply chain bottlenecks hindering expansion. | |
| Local Economic Impact and Closed-Loop Water Recycling | 4 | 5 | 2 | 2 | Matt brings up public relations challenges regarding local community impact and water consumption myths. Sachin explains that closed-loop cooling systems consume minimal net water and highlights tax base and infrastructure benefits for rural areas. | |
| Site Selection Criteria for Next-Generation Data Centers | 3 | 5 | 1 | 1 | Matt asks about datacenter site selection criteria and Sachin's role as Head of Industrial Compute. Sachin outlines key location criteria and describes the internal challenge of allocating scarce compute capacity among competing teams. | |
| Sachin Katti's Career Path Across Academia, Startups, and Industry | 2 | 3 | 1 | 1 | Matt asks Sachin about his unique career path across academia, startups, and major tech firms. Sachin highlights his background as a Stanford professor and Intel CTO, noting how OpenAI uniquely merges research lab, startup, and scale. | |
| OpenAI's Infrastructure Partnerships and Project Stargate | 5 | 5 | 3 | 3 | Matt demonstrates deep industry awareness by naming various compute partnerships and questioning if Project Stargate evolved. Sachin clarifies that Stargate serves as an overall umbrella strategy rather than a single joint venture. | |
| The Abilene Texas Supercluster and Expansion Sites | 4 | 5 | 2 | 2 | Matt inquires about the Abilene supercluster and how datacenter buildouts are financed. Sachin explains that OpenAI operates as an off-take tenant while cloud and infrastructure partners handle the capital and construction. | |
| Accelerated Chip Development and AI-Assisted Hardware Design | 4 | 5 | 1 | 1 | Matt notes the remarkably fast nine-month tapout timeline for the Jalapeno chip. Sachin attributes this speed to experienced talent, Broadcom partnership, knowing workload specifications, and using AI tools to accelerate hardware design. | |
| Interconnect Reliability and the Open-Source MRC Protocol | 3 | 6 | 1 | 1 | Matt asks about the newly open-sourced MRC networking protocol. Sachin uses a city traffic routing analogy to explain how multi-path packet spraying ensures fault tolerance across massive 100,000 GPU clusters. | |
| Industrial Bottlenecks, Hardware Lead Times, and Labor Demands | 4 | 6 | 2 | 2 | Matt brings up hardware bottlenecks like memory and electrician shortages, along with OpenAI's new guaranteed capacity offering. Sachin details long lead times for physical equipment and recontextualizes guaranteed capacity as securing enterprise AI supply. |
Statements from this episode (21)
Katti: AI compute buildout is among largest human projects in history
“It definitely feels like one of the largest things humanity has ever built, effectively.”
Katti: OpenAI must build its own compute infrastructure alongside partners
“I think what's becoming clear is to build the kind of compute we need and at this scale we have to not just rely on getting compute from our partners. We increasingly have to take a much more active role in building and getting that compute that we need.”
Katti: OpenAI commits to not taking existing power from local grids
“Whenever we build a data center anywhere, we make it a hard commitment that we are not taking power away from the grid. In fact, we are investing in the grid to generate new power so that we can consume it for data centers.”
Katti: Nuclear power is the densest, cleanest energy for AI data centers
“I think it is the densest form of energy we can all produce and consume and it's also clean. So I think definitely would be a good source of massive scalable energy for our data centers.”
OpenAI's Jalapeño chip optimizes tokens produced per watt
“So the key metric that Jalapeno is optimizing is maximizing the number of tokens you can produce per watt.”
Inference likely accounts for the majority of OpenAI's total compute
“Inference is a big, perhaps even the majority on compute.”
Katti: Modern AI model training consists heavily of inference workloads
“We don't like to make a distinction between Training and infants, because a lot of training is now infants. So when we train a new model, we are generating synthetic data, for example. That's inference. When we train a new model, we are doing post-train, and t…”
Sachin Katti: OpenAI tripled compute and tripled revenue
“We tripled compute and we tripled revenue.”
Katti: Demand far outstrips OpenAI's compute supply, zero goes to waste
“Demand far outstrips. Compute supply today. So anything we can bring online, we consume immediately. So there's no compute that is going to waste for us.”
Katti: Data centers do not net consume new water due to recycling
“It's a misperception that data centers consume a lot of water. It's anything. They consume so little water for what they do. And all of that water is recycled. So we don't net consume new water.”
Katti: OpenAI sources compute from all major cloud hyperscalers
“We have compute from, effectively, many sources. So, Microsoft, obviously, is a big partner, important partner. We also have compute, as we have announced, from AWS, Ion Google. So, we have compute from all of the hyperscalers, effectively.”
Katti: OpenAI considers designing and building its own data centers
“As we go forward obviously there'll be building on all of these relationships but also looking at more options where we design the compute, the data center itself, also potentially even build the data center ourselves.”
Katti: OpenAI's Abilene data center is operational and training latest models
“It's up and running. It's being used for training the last two models more actually.”
OpenAI taped out its custom Jalapeño chip in just nine months
“Yes, it was incredibly quick. Nine months is very, very fast.”
Katti: Many OpenAI chip team members previously designed Google TPUs
“They have, many, many of the team have designed TPU chips at Google in the past.”
Katti: AI will soon design systems and chips for next-gen AI
“We do believe that the world of Likersh is not that far, where AI will design the systems it needs to train and run the next generation of AI.”
Katti: Turbine and transformer manufacturers face multi-year lead times to expand capacity
“Those industries have historically have not added much capacity for the last decade or so ago, and they've suddenly experienced a demand shock. And it takes years before you can add capacity to produce more turbines and transformers.”
Katti: Skilled labor shortages will become an increasing bottleneck for AI expansion
“No, I think there is definitely a shortage of electricians, plumbers, all kinds of trades, you name it. So anything we can do to train more folks to be able to do those, there are very well-paying jobs that a lot of us, all of the hyperscalers, all of the labs…”