AI inference
2 statements across 2 episodes · 1 bullish · 1 bearish · 2 people on the record · first statement Apr 10, 2025 by Sridhar Ramaswamy · across every show →
Everything said about AI inference, oldest first
Apr 10, 2025 positive
Ramaswamy: AI inference will become significantly faster and cheaper in 2025
“The world of inference, not foundation models, the world of inference is going to go through so much change this year, both in terms of GPU availability, which is easing up quite a bit, But also in terms of people like Grok, I think the one with the K or the Q…”
Jul 23, 2026 bearish
Feldman: AI inference is bottlenecked by data movement, causing GPU slowness
“In inference in AI, it's the exact opposite. You move a huge amount of data, all the weights, from memory to compute, and you need one calculation to generate the next word. And then you have to do it again. So all the time is dominated by the movement of data…”