Systolic Array
topic on 2 shows · 4 statements across 2 episodes
4 statements about Systolic Array, every show
Pope: Large systolic arrays are unbeatable in area and power efficiency
“Make a really large systolic array. You can't beat that in area or power efficiency.”
Pope: Mixture of experts maps well to systolic arrays, attention does not
“The mixture of expert layer maps really well, but the attention does not.”
Pope: MatX splits large systolic arrays without sacrificing efficiency
“Take a really large systolic array, but have a way to split it up into pieces without losing efficiency. So sort of that is the core of the design for us.”
Hotz: Systolic arrays are the wrong architectural choice for AI chips
“I think systolic arrays are the wrong choice. Systolic array, I think they have systolic arrays because that was the guy's PhD. And of course Amazon makes... They are very power efficient, but it becomes hard to schedule a lot of stuff. On them, if you're not …”