Prediction Open AI assessment confidence: 85% certainty 4/5 debate potential 3/5

Belizaire: Batch computing will quickly consume more energy than real-time compute

John Belizaire · Energy is now the ‘primary bottleneck’ for AI · May 21, 2024 · at 35:27

John Belizaire, CEO of Soluna, discusses the growth trajectory of batchable AI workloads compared to real-time computing services.

0:00 / 0:17exact quote · 17.1s
720p mp4 · rendered on demand · StarZero watermark
“If you look at the whole pie of the types of compute that's out there the batchable portion is growing faster than the rest, and it's become, it will quickly become a larger portion of the over, overall pie, and it will quickly have more energy demands than the rest.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from John Belizaire

Opinion
Belizaire: Data centers should leave population centers and go behind-the-meter
“Maybe data centers shouldn't be at population centers anymore. They should all be behind the meter and be dispatchable processes”
John Belizaire May 21, 2024 ▶ 52:47 Energy is now the ‘primary bottleneck’ for AI
Assertion Supported
Belizaire: AI servers require ten times the power density of traditional compute
“When you look at today's data center design it's designed for traditional compute processes and servers that use a 10th of the power that this new technology uses. It uses 10 times the amount of power 10 times the amount of power density is in a particular fac…”
John Belizaire May 21, 2024 ▶ 24:51 Energy is now the ‘primary bottleneck’ for AI
Assertion Supported
Belizaire: Hyperscalers are designing data centers dedicated exclusively to AI
“Some of the big hyperscalers are working on all their own designs. And these facilities will only be doing AI. It's at that level where the entire building and facility would just be AI processing.”
John Belizaire May 21, 2024 ▶ 25:15 Energy is now the ‘primary bottleneck’ for AI
Assertion Supported
Belizaire: 300 TWh of wasted energy is available globally each year
“We think there's about 300 terawatt hours of this wasted energy on a global basis available every single year.”
John Belizaire May 21, 2024 ▶ 34:50 Energy is now the ‘primary bottleneck’ for AI
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 100 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.