decode

1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement May 20, 2026 by Gavin Baker · across every show →

Everything said about decode, oldest first

May 20, 2026 neutral
Insight
Baker: LLM pre-fill is capacity-bound while decode is bandwidth-constrained
“And that is fundamentally a memory capacity bound problem. Decode is the process of generating new tokens, and that is memory bandwidth constraint.”
Gavin Baker May 20, 2026 ▶ 45:23 Watts, Wafers, and the Future of AI Infra | Gavin Baker · Invest Like The Best
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 60 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.