accelerator
also referred to as: accelerators
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Aug 3, 2023 by Tri Dao · across every show →
Everything said about accelerator, oldest first
Aug 3, 2023 bullish
FlashAttention techniques generalize across accelerators with asymmetric memory
“I expect the idea to be broadly these ideas to be broadly applicable to different hardware. As long as, I think the main idea is you have, like, asymmetry in, in memory hierarchy, which tends to be everywhere, you know, in, in a lot of a lot of accelerators.”