FlashAttention, every mention

2 scenes (2026) · ← back to FlashAttention

tap a year for its mentions
0011212023202420252026episodesmentions
0112023202420252026episodes it came up in
0010.5212023202420252026episodesmentions per episode

every year 2026 anyone Dan Fu 2Shreya Rajpal 1

Verbatim, from the transcripts: the passages where FlashAttention comes up

loading…

The End of GPU Scaling? Compute & The Agent Era — Tim Dettmers (Ai2) & Dan Fu (Together AI) Jan 22, 2026 · 2 mentions

  • ▶ 2:52 Dan Fu So, uh, I developed things like flash attention, which was a efficient kernel for the, one of the core operations of,
  • ▶ 48:28 Dan Fu Take this flash attention kernel and modify it to do some other thing.
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.