FlashAttention 2
product on 1 show · 2 statements across 2 episodes · said 9 times in 5 episodes since 2023
Mentions by year, every show
tap a year for its mentions
Latent Space 9
2025 3 mentions in 2 episodes 2 per episode
2024 2 mentions in 2 episodes 1 per episode
2023 4 mentions in 1 episode
every mention on every show, scene by scene, with the transcript →
2 statements about FlashAttention 2, every show
AMD MI300X outperforms Nvidia H100 on FlashAttention-2 and memory-bound workloads
“We found that it's great for flash attention to specifically, we were able to be H-one hundred. We also found that like the less time you spend in like dense compute, like the less time you spend in tensor cores specifically, or less time you spend in lower bi…”