matrix multiply unit
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Feb 12, 2026 by Jeff Dean · across every show →
Everything said about matrix multiply unit, oldest first
Feb 12, 2026 neutral
Dean: Accelerator batching is driven by 1000x SRAM data movement energy costs
“And so, all of a sudden, this is why your accelerators require batching, because if you move, like, say, the parameter of a model from SRAM on the chip into the multiplier unit, that's gonna cost you a thousand PicoTools, so you better make use of that, that t…”