John Belizaire, CEO of Soluna, discusses the growth trajectory of batchable AI workloads compared to real-time computing services.
0:00 / 0:17exact quote · 17.1s
720p mp4 · rendered on demand · StarZero watermark
“If you look at the whole pie of the types of compute that's out there the batchable portion is growing faster than the rest, and it's become, it will quickly become a larger portion of the over, overall pie, and it will quickly have more energy demands than the rest.”
quote is from the automated transcript, cleaned for reading:
filler sounds and stutters are removed, nothing is rephrased. names can be misheard
(the analysis reads context, assessments check outside sources). how →
More from John Belizaire
Opinion
Belizaire: Data centers should leave population centers and go behind-the-meter
“Maybe data centers shouldn't be at population centers anymore. They should all be behind the meter and be dispatchable processes”
John BelizaireMay 21, 2024▶ 52:47Energy is now the ‘primary bottleneck’ for AI
AssertionSupported
Belizaire: AI servers require ten times the power density of traditional compute
“When you look at today's data center design it's designed for traditional compute processes and servers that use a 10th of the power that this new technology uses. It uses 10 times the amount of power 10 times the amount of power density is in a particular fac…”
John BelizaireMay 21, 2024▶ 24:51Energy is now the ‘primary bottleneck’ for AI
AssertionSupported
Belizaire: Hyperscalers are designing data centers dedicated exclusively to AI
“Some of the big hyperscalers are working on all their own designs. And these facilities will only be doing AI. It's at that level where the entire building and facility would just be AI processing.”
John BelizaireMay 21, 2024▶ 25:15Energy is now the ‘primary bottleneck’ for AI
AssertionSupported
Belizaire: 300 TWh of wasted energy is available globally each year
“We think there's about 300 terawatt hours of this wasted energy on a global basis available every single year.”
John BelizaireMay 21, 2024▶ 34:50Energy is now the ‘primary bottleneck’ for AI
Made with StarZero
Turn any episode into a week of clips.
This entire site, over 100 episodes transcribed, diarized, checked and made playable,
runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the
moments worth sharing, cuts them, captions them, and reframes them for every feed.
We use essential cookies to make the site work. With your permission we
also use analytics cookies (Google Analytics and Mixpanel) to understand
usage and improve StarZero. See our Cookie Policy.