MI300X
product on 1 show · 2 statements across 1 episodes
2 statements about MI300X, every show
AMD MI300X GEMM performance increased from 400 to 650 TFLOPS via software
“So when MI 300 X first dropped, if you run like an MLP gem or something, you would get like 400 T flops. Now that number is, you know, more like six, 606 107 650 or so just in like the gem back ends themselves.”
AMD MI300X outperforms Nvidia H100 on FlashAttention-2 and memory-bound workloads
“We found that it's great for flash attention to specifically, we were able to be H-one hundred. We also found that like the less time you spend in like dense compute, like the less time you spend in tensor cores specifically, or less time you spend in lower bi…”