FlashInfer
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Sep 23, 2025 by Diego Bachman · said 2 times in 2 episodes since 2025 · across every show →
Mentions by year
brought up most by Yining Zhang (1), Diego Bachman (1)
tap a year for its mentions
2025 2 mentions in 2 episodes 1 per episode
Everything said about FlashInfer, oldest first
Sep 23, 2025 bullish
Bachman: Power Retention Delivers 100x Inference Speedup at 64k Context
“And at 64 K tokens, We get something like a 10 X speed up at training, but at inference time, because you're not only saving flops at inference time, but also paging in and out of memory of the KV cache, you actually get a hundred X speed ups from power retent…”