memory capacity

2 statements across 2 episodes · 0 bullish · 1 bearish · 2 people on the record · first statement Apr 23, 2026 by Dylan Patel · across every show →

Everything said about memory capacity, oldest first

Apr 23, 2026 bearish
Prediction Didn’t hold up
Patel: Incremental memory fab capacity will not arrive until late 2027 or 2028
“Even if they wanted to build as fast as possible, it doesn't come till 28 early, late 27 at best.”
Dylan Patel Apr 23, 2026 ▶ 34:48 The Supply and Demand of AI Tokens | Dylan Patel Interview · Invest Like The Best
May 20, 2026 neutral
Insight
Baker: LLM pre-fill is capacity-bound while decode is bandwidth-constrained
“And that is fundamentally a memory capacity bound problem. Decode is the process of generating new tokens, and that is memory bandwidth constraint.”
Gavin Baker May 20, 2026 ▶ 45:23 Watts, Wafers, and the Future of AI Infra | Gavin Baker · Invest Like The Best
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 60 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.