Edge Data Centers
topic on 1 show · 4 statements across 2 episodes
4 statements about Edge Data Centers, every show
Kann: 300 MW data centers have lower cost per FLOP than edge
“My guess is, you know, your 300 megawatt data center on a fully loaded levelized cost of flop is just gonna be cheaper.”
Shifting inference to edge data centers will reduce efficiency and increase energy costs
“I think as you shrink the system down, you will get, you will lose an efficiency. You will be trying to build these 20 megawatt data centers and maybe footprints or facilities that weren't designed initially for those workloads. So yes, I think total energy co…”
80% of AI inference compute will move to the edge by 2035
“So I would say that we could be getting 80% of our compute done locally and leaving 20% of the heavy lifting or the more esoteric, the more corner case compute for the data center cloud. That is, of course, excluding the training. The training will Continue to…”