May 21, 2024 · 54m · green-blueprint
Energy is now the ‘primary bottleneck’ for AI
John Belizaire · 16m spoken Brian Janous · 13m spoken Stephen Lacey · 11m spoken Michelle Solomon · 8m spoken
0:00 / 0:00
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
In this Transition AI roundtable, host Stephen Lacey and energy experts Brian Janus, Michelle Solomon, and John Belizaire examine the unprecedented power demands of artificial intelligence, warning against a utility rush toward natural gas while presenting practical solutions such as grid-enhancing technologies, advanced reconductoring, and co-locating batch computing with curtailed renewable energy.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. How this is scored →
The hosts as informed peer 3.2 Guest teaching 3.8 Guest disagreement 1.1 The hosts pushing back 0.9
speaking balance: gold is the hosts, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 22:55 Belizaire rejects underestimating AI power demands
Belizaire forcefully cautions utility professionals against downplaying AI demand projections, stating that underestimating the bottleneck is the biggest mistake the sector could make.
Hardest push from the hosts ▶ 22:33 Lacey presses on the fundamental bottleneckLacey directly intervenes to pin down whether chip shortages or power capacity represent the definitive operational constraint.
Biggest teaching moment ▶ 9:39 Janus breaks down the 2010s cloud efficiency mythJanus clarifies that past data center power flatness was driven by decommissioning inefficient on-premises servers rather than pure operational efficiencies.
The host holds their own ▶ 38:57 Lacey contextualizes the 2.5 terawatt backlogLacey demonstrates domain command by citing the specific 2.5-terawatt clean energy queue and grid planning bottlenecks to challenge proposed solution timelines.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | The hosts as informed peer | Guest teaching | Guest disagreement | The hosts pushing back | Why |
|---|---|---|---|---|---|---|
| Historical Perspectives and the Emergence of AI Power Bottlenecks | 0 | 0 | 0 | 0 | Host Stephen Lacey opens with a solo monologue framing historical power demand predictions against current AI load forecasts. Host-side interactive metrics are scored zero per monologue rules. | |
| Introducing Panelists Brian Janus, Michelle Solomon, and John Belizaire | 4 | 4 | 1 | 1 | Lacey introduces the panel and prompts Michelle Solomon on load growth data. Solomon delivers detailed statistics on FERC filings and contrasts Xcel Energy's coal retirement plans with Duke Energy's proposed gas additions. | |
| The Cloud Transition vs the New Demands of Artificial Intelligence | 4 | 5 | 1 | 1 | Lacey asks Brian Janus about procurement challenges post-ChatGPT. Janus educates the audience on how the 2010s cloud migration masked underlying growth by consolidating inefficient enterprise data centers into hyperscale facilities. | |
| Harnessing Curtailed Renewable Energy for Batchable Computing | 4 | 5 | 1 | 1 | John Belizaire breaks down the distinction between real-time workloads and batchable compute tasks like machine learning and Bitcoin mining that can absorb curtailed renewables. Lacey prompts him on technical feasibility. | |
| Big Tech CapEx Trends and the Power Availability Constraint | 4 | 4 | 2 | 2 | Lacey questions whether power or chip availability is the ultimate constraint for AI expansion. Janus unequivocally identifies power as the primary bottleneck, citing tech capex trends. | |
| The Scale of AI Demand and Data Center Redesign | 3 | 5 | 2 | 1 | Belizaire rejects underestimating AI power demands, invoking Hurricane Sandy to warn utilities against complacency regarding tenfold power density increases in new data centers. | |
| Scrutinizing the Southeastern Rush to Gas Generation and EPA Regulations | 4 | 4 | 1 | 1 | Lacey probes the Southeastern utilities' dash to gas amid EPA regulations. Solomon explains how utilities use load panic to justify building combined cycle plants and pushing back against EPA rules. | |
| Integrating Grid-Enhancing Tech and Flexible Behind-the-Meter Resources | 3 | 4 | 1 | 1 | Janus explains how behind-the-meter assets and grid-enhancing technologies can offer flexibility instead of defaulting to new combined cycle gas plants. | |
| Scaling Batch Processing and Reforming Utility-Customer Collaboration | 4 | 4 | 1 | 1 | Belizaire answers audience questions relayed by Lacey, urging utilities to adopt lateral thinking and interrogate data center developers on workload flexibility and siting. | |
| Overcoming Grid Interconnection Backlogs with Advanced Conductors | 4 | 5 | 1 | 1 | Lacey raises the two-and-a-half terawatt interconnection backlog. Solomon highlights advanced conductors and reconductoring as rapid 18-to-36-month solutions to quadruple transmission capacity. | |
| Data Center Siting Shifts and Corporate Carbon Accounting Challenges | 4 | 5 | 1 | 1 | Janus examines recent nuclear co-location deals and critiques carbon accounting loopholes that let companies claim 100% clean energy while regional utilities build gas plants to meet their peaks. | |
| Assessing Advanced Nuclear Horizons Versus Deployable Clean Technologies | 4 | 4 | 2 | 1 | Lacey asks whether advanced nuclear or fusion is necessary. Belizaire, Janus, and Solomon agree that existing technologies are sufficient for this decade and warn against overestimating nuclear timelines. | |
| Panel Recommendations for Regulators and Utilities | 3 | 4 | 1 | 1 | The guests provide parting policy and operational recommendations for regulators and utilities, including Belizaire's collaborative problem-solving framework. | |
| Concluding Remarks and Additional Resources | 0 | 0 | 0 | 0 | Lacey delivers closing credits and provides informational links for audience research. Monologue rules apply with zero host interactive metrics. |
Statements from this episode (26)
Grid Strategies: 5-year US power demand growth forecast jumped to 4.7%
“A recent report by Grid Strategies, which is a grid firm, found that demand forecasts were increasing. They found that there is a shift from 2.6% increase in demand over the next five years to 4.7% increase in demand over the next five years.”
Solomon: AI uses 1-2% of US electricity, may triple by 2030
“AI right now is using about one to two percent of our electricity, and some reports expect it to maybe triple by 2030.”
Solomon: Xcel Energy plans to retire all coal plants by early 2030s
“One really great example is Excel Energy. So they do see a large forecasted increase in electricity demand, but yet they still plan to retire all of their coal plants by the early 20 thirties and install significant amounts of new renewables.”
Solomon: Duke Energy plans nearly 9 GW of new gas plants
“Duke Energy, for instance, they include plans for nearly nine gigawatts of new gas and almost seven of those are, they're proposed as combined cycle power plants that are designed to run a high percentage of the time, not designed to meet new peaks in demand.”
Janus: 2010s flat data center power was driven by cloud migration, not efficiency
“What was happening is you had a lot of businesses shutting down their own very inefficient data centers that were using multiples of the amount of electricity that a hyperscale data center would use. And the hyperscale data center could absorb that with signif…”
Janus: Big tech hyperscalers grew from hundreds of megawatts to gigawatts by 2020
“Early in the two, you know, 2010 time frame, Microsoft, Amazon, Google, you know, they maybe all had a few hundred megawatts of data center capacity. Well, now you get to the end of that decade, now they're all sitting on a few gigawatts of capacity”
Janus: Most utility employees have never worked during an era of load growth
“Most people that work at a utility today have never worked at a utility during an era of growth.”
Janus: 2x more efficient AI chips will lead tech giants to deploy 2x more chips
“And, you know, I had someone ask me the other day, well, what happens if, you know, if NVIDIA comes out with a chip that's twice as efficient? And my response to that is, well, then Meta or Microsoft or Google will plug in twice as many chips. If they have the…”
Janus: Power availability, not chip supply, is the primary constraint for AI
“Absolutely power. Absolutely. I think, you know, six to 12 months ago, I think a lot of the companies were concerned about chip availability, but I think everyone has come around to realize that that is not going to be the biggest constraint.”
Belizaire: AI servers require ten times the power density of traditional compute
“When you look at today's data center design it's designed for traditional compute processes and servers that use a 10th of the power that this new technology uses. It uses 10 times the amount of power 10 times the amount of power density is in a particular fac…”
Belizaire: Hyperscalers are designing data centers dedicated exclusively to AI
“Some of the big hyperscalers are working on all their own designs. And these facilities will only be doing AI. It's at that level where the entire building and facility would just be AI processing.”
Solomon: New EPA rules require CCS on high-utilization gas plants by early 2030s
“The plants that they regulate as far as new gas plants Are combined cycle gas plants that run at over 40% capacity factors that will need to install CCS by the early 20 thirties.”
Solomon: Utilities cite load growth panic to push back on EPA gas rules
“So I think there is Some reason to believe that the timing of the kind of panic conversation around load growth in addition to the proposed new combined cycle plants could, you know, have something to do with those proposed EPA rules.”
Solomon: AI does not inherently require new natural gas plants
“AI is not a special unicorn that requires a gas plant to meet its electricity demand.”
Janus: Grid Capacity Shortfalls Only Occur During Limited Peak Hours Annually
“There's plenty of power most of the time. There's, you know, a number of hours a year where we don't have enough power, and so that's really what we're trying to solve for.”
Janus: Utilities Can Meet Load Growth Without Heavy Natural Gas Buildout
“I think we can. I think there is a lot of levers that we have at our disposal, you know, and I have, I've had empathy for my friends in the southeast. I know that they're under a lot of pressure, and I know that, you know, they, they're at the tip of the spear…”
Belizaire: 300 TWh of wasted energy is available globally each year
“We think there's about 300 terawatt hours of this wasted energy on a global basis available every single year.”
Belizaire: Batch computing will quickly consume more energy than real-time compute
“If you look at the whole pie of the types of compute that's out there the batchable portion is growing faster than the rest, and it's become, it will quickly become a larger portion of the over, overall pie, and it will quickly have more energy demands than th…”
Solomon: Advanced conductors can be deployed in 18 to 36 months
“You can replace the existing transmission conductor with this new advanced conductor in as little as 18 to 36 months with much fewer permitting requirements and things like that.”
Solomon: Advanced conductors can quadruple transmission capacity by 2035
“Basically we found that you could add up to four times the amount of transmission capacity that you could in a constrained transmission environment like the one we're in right now by using advanced conductors. So by 2035.”
Janus: Amazon Talen Nuclear Deal Uses Existing Capacity, Not Net New
“Amazon Talon deals is, it's sort of a corollary to what John's talking about, where, you know, what you're doing is saying, Go, go to where the power is... Here you're just saying go to where the capacity is, right? And you could argue whether it's clean or no…”
Janus: Data Center Siting Shifted from Fiber to Eyeballs to Power
“If you look at the history of the cloud industry, it started with a focus on fiber, right? Get as close to the network as possible. That's why you have concentrations in places like Northern Virginia and Amsterdam, because those were some of the biggest networ…”
Janus: Carbon Accounting Allows Net-Zero Claims While Utilities Add Gas
“Both the things can be true that a company could be a hundred percent zero carbon by one measure, and a utility is building gas plants to support their load, so, and that's the problem, right? The carbon accounting rules don't necessarily connect the dots in a…”
Janus: Advanced nuclear and fusion will not solve grid problems this decade
“They're not solving any problems this decade, right? That is a 20 thirties and probably a late 20 thirties. Opportunity.”