FlashAttention-2
2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Aug 3, 2023 by Tri Dao · said 9 times in 5 episodes since 2023 · across every show →
Mentions by year
brought up most by Quentin Anthony (2), Alessio Fanelli (1)
tap a year for its mentions
2025 3 mentions in 2 episodes 2 per episode
2024 2 mentions in 2 episodes 1 per episode
2023 4 mentions in 1 episode
Everything said about FlashAttention-2, oldest first
Aug 3, 2023 positive
Nov 3, 2025 bullish
AMD MI300X outperforms Nvidia H100 on FlashAttention-2 and memory-bound workloads
“We found that it's great for flash attention to specifically, we were able to be H-one hundred. We also found that like the less time you spend in like dense compute, like the less time you spend in tensor cores specifically, or less time you spend in lower bi…”