High Bandwidth Memory

3 statements across 1 episodes · 2 bullish · 0 bearish · 1 people on the record · first statement Aug 25, 2026 by Neil Movva · across every show →

Everything said about High Bandwidth Memory, oldest first

Aug 25, 2026 positive
Disclosure
Movva: Sail's Custom Chip Strategy Sidesteps HBM by Offloading to Flash
“When I talk about building custom chips, and they ask me, oh, so what's different? Basically, it's about sidestepping the HBM shortage and focusing on More extreme offload to other forms of memory, such as flash.”
Neil Movva Aug 25, 2026 ▶ 1:14:23 Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
Aug 25, 2026 neutral
Assertion Partly supported
Nvidia Blackwell Has 288GB of HBM but Only 500MB of SRAM
“Blackwell has 288 gigabytes of HBM capacity around the logic die, and the logic die itself maybe only has like 500 megabytes of SRAM. So it's possibly multiple orders of magnitude, three orders of magnitude difference in density for DRAM versus SRAM.”
Neil Movva Aug 25, 2026 ▶ 26:04 Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
Aug 25, 2026 bullish
Insight
Movva: Compute startups should primarily attack Nvidia's reliance on HBM
“You want to pick something and say, I think they've underpriced the impact of how short we're going to be on HBM. We're going to push really hard in this other direction instead, which, you know, as an aside, I do think is probably the thing to attack most.”
Neil Movva Aug 25, 2026 ▶ 1:19:42 Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 60 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.