dense matrix multiplications
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Aug 31, 2023 by Noam Shazeer · across every show →
Everything said about dense matrix multiplications, oldest first
Aug 31, 2023 positive
Shazeer: Deep Learning Succeeds Because Hardware Is Optimized for Dense Matrix Multiplication
“The reason this whole field is working so well is because Now we have this magic hardware that's great at these dense matrix multiplications. And so you can do them like orders of magnitude faster than you can do anything that involves poking around in memory.”