inference

5 statements across 4 episodes · 4 bullish · 0 bearish · 4 people on the record · first statement May 13, 2026 by Krishna Rao · across every show →

Everything said about inference, oldest first

May 13, 2026 neutral
Insight
Rao: More efficient inference directly increases reinforcement learning efficiency
“If we're doing reinforcement learning on the model, it's basically inference within a sandbox with a reward function, right? And so if the model's better at more efficient inference, that RL is more efficient as well.”
Krishna Rao May 13, 2026 ▶ 9:44 Inside Anthropic's $100 Billion Al Compute Commitment | CFO Krishna Rao · Invest Like The Best
May 20, 2026 bullish
Assertion Not checkable as stated
Baker: Anthropic has strongly positive gross margins on inference
“Anthropic I'm sure is at very positive gross margins on inference today.”
Gavin Baker May 20, 2026 ▶ 10:40 Watts, Wafers, and the Future of AI Infra | Gavin Baker · Invest Like The Best
May 20, 2026 bullish
Prediction Open · timeframe May 2036
Baker: Disaggregated inference will extend GPU lifespans to 10-15 years
“And the disaggregation of inference means that I think these GPUs are going to have 10 or 15 year lives.”
Gavin Baker May 20, 2026 ▶ 49:23 Watts, Wafers, and the Future of AI Infra | Gavin Baker · Invest Like The Best
Jun 30, 2026 bullish
Assertion Supported
Wachen: Over $1B in AI Compute Revenue Generated Every Day
“Every day there's over a billion dollars of revenue in this category, and a lot of it's inference.”
Rob Wachen Jun 30, 2026 ▶ 38:06 The Two Harvard Dropouts Who raised $800M to take on NVIDIA · Invest Like The Best
Jul 28, 2026 bullish
Prediction Not checkable as stated
Altman: Massive Inference Revenue Will Easily Fund Frontier Model Training
“We will have so much usage of our models that we do not need to be a gigantically high margin business to be able to afford model training. Like, so much of our future compute plans Will be used to sell inference to customers that even if we can enjoy a modest…”
Sam Altman Jul 28, 2026 ▶ 13:21 Sam Altman on AGI, Compute, and Human Agency · Invest Like The Best
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 60 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.