StarZero All shows Try the podcast clipper →

memory bandwidth

2 statements across 2 episodes · 0 bullish · 1 bearish · 2 people on the record · first statement Nov 22, 2023 by Jeff Seibert · across every show →

Everything said about memory bandwidth, oldest first

Nov 22, 2023
Assertion Supported
Seibert: Top AI models are bottlenecked by memory bandwidth, not just compute
“It's very clear the top models are memory bound as well as CPU bound. So you can't just make the CPUs, the GPUs faster. You need to increase memory bandwidth in sort of on par with that.”
Jeff Seibert Nov 22, 2023 ▶ 35:36 Jeff Seibert: Why OpenAI Will Become an Infrastructure Play | E1085 · 20VC with Harry Stebbings
Oct 6, 2025 negative
Insight
Feldman: Memory bandwidth, not compute speed, limits GPU AI inference
“And that includes memory, which has, for inference, is the fundamental limiter for the GPU architecture. And so it doesn't matter how much faster the chip goes. It matters how much faster the memory bandwidth is.”
Andrew Feldman Oct 6, 2025 ▶ 19:30 Cerebras CEO, Andrew Feldman on Why Raise $1BN and Delay the IPO & Why NVIDIA’s Worried About Growth · 20VC with Harry Stebbings
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more