Kernel fusion
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Aug 3, 2023 by Tri Dao · across every show →
Everything said about Kernel fusion, oldest first
Aug 3, 2023 negative
Kernel fusion sacrifices flexibility for researchers experimenting with attention
“When you do kernel fusion is a little bit you lose a little bit of flexibility in the sense that, hey, now you have for example, is flash attention is just a subroutine that you would call to do attention. But as a researcher, let's say you don't want that exa…”