High Bandwidth Memory
also referred to as: hbm
2 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Feb 26, 2026 by Reiner Pope · across every show →
Everything said about High Bandwidth Memory, oldest first
Feb 26, 2026 neutral
Pope: SRAM is an order of magnitude faster per token than HBM
“There's, yeah, there's just some simple math of, like, how long does it take you to read through all of HBM? It takes about 20 milliseconds, and so that's the amount of time per token it runs. Yes. Whereas the amount of time to read through all of SRAM is much…”
Feb 26, 2026 bullish
Pope: MatX combines SRAM and HBM for cheap, low-latency AI chips
“It is actually possible to do both in the same chip. You, it's kind of an obvious thing. You say you take the HPM, you take the SRAM, put them together in the same chip, you put the weights in SRAM, and you put the all of the inference data in HPM. That is wha…”