Lockmiller: NVIDIA chip power jumps from 300W to 1,200W per chip
Chase Lockmiller · Frontier Forum: An energy-first approach to data centers · Oct 22, 2024 · at 20:09
Crusoe CEO Chase Lockmiller outlines the rapid escalation of power density across NVIDIA GPU generations and its impact on data center cooling.
0:00 / 0:20exact quote · 20.5s
720p mp4 · rendered on demand · StarZero watermark
“If you look at, like, the last generation NVIDIA chip, it was the Ampere so the A-one hundred that, that consumed about 300 watts per chip. The Hopper, the current generation, the H-one hundred, H-two hundred those are about 700 watts per chip. And the Blackwell is sort of the next generation, the GB 200 that'll be about 1200 watts per chip.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Chase Lockmiller
Lockmiller: Power is now the primary constraint scaling AI
“Power is the main constraint right now.”
Lockmiller: Half an H100 per US adult would require 250 GW
“If every, you know, American adult used half an H 100 as, You know, a form of co-pilot for their, you know, daily workflows and, you know, social interactions, et cetera. Like, that would require 250 gigawatts of power, right?”
Lockmiller: Crusoe is developing compute at an upstate New York Alcoa site
“You know, other markets like upstate New York you know, we're working on a former Alcoa factory that's you know, powered by a large hydro dam that's, you know, being currently massively underutilized.”
Lockmiller: Remote AI training in clean-energy hubs improves on aluminum smelting model
“Training a large language model is a far better manifestation of that trade where, you know, you can move data across subsea cables to get to a data center based in Iceland. You can run your back propagation and large scale pre-training on significant amounts …”
Lockmiller: AI data centers drive massive shortages of electricians, welders, and plumbers
“We're experiencing massive shortages of electricians, of welders, of plumbers, like these large scale liquid cooling architectures that we've described that require tremendous amounts of plumbing, right? So you're building all these different pipes to move wat…”