inference

9 statements across 5 episodes · 5 bullish · 0 bearish · 3 people on the record · first statement Oct 13, 2024 by Jensen Huang · across every show →

Everything said about inference, oldest first

Oct 13, 2024 bullish
Opinion
Huang: NVIDIA's moat in inference will be greater than in training
“And I'm sure I said it would be greater.”
Jensen Huang Oct 13, 2024 ▶ 16:09 Ep17. Welcome Jensen Huang | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
Oct 13, 2024 bullish
Insight
Huang: AI Inference and Post-Training Are Now Just as Hard as Pre-Training
“People used to think that pre-training was hard, and inference was easy. Now everything is hard.”
Jensen Huang Oct 13, 2024 ▶ 5:38 Ep17. Welcome Jensen Huang | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
Oct 13, 2024 bullish
Assertion Partly supported
Gerstner: 40% of NVIDIA's revenue already comes from inference
“40% of their revenues are already inference.”
Brad Gerstner Oct 13, 2024 ▶ 20:17 Ep18. Jensen Recap - Competitive Moat, X.AI, Smart Assistant | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
Oct 13, 2024 positive
Assertion Supported
Gerstner: AI inference costs dropped 90% over the past year
“What we know is that the cost of inference has fallen by 90% over the course of last year.”
Brad Gerstner Oct 13, 2024 ▶ 38:33 Ep18. Jensen Recap - Competitive Moat, X.AI, Smart Assistant | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
Nov 21, 2024
Assertion Supported
Gerstner: Microsoft said almost all $10B AI revenue is inference
“Microsoft has said of its ten billion dollars in AI revenue, it's almost all inference.”
Brad Gerstner Nov 21, 2024 ▶ 16:57 Ep20. AI Scaling Laws, DOGE, FSD 13, Trump Markets | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
Nov 21, 2024
Assertion Partly supported
Gerstner: Nvidia stated half its revenue comes from inference
“We know Nvidia has said half of their revenue is inference”
Brad Gerstner Nov 21, 2024 ▶ 17:04 Ep20. AI Scaling Laws, DOGE, FSD 13, Trump Markets | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
Dec 23, 2024 neutral
Insight
Patel: Modern AI training requires more inference compute than weight updates
“In fact, there's more inference in training than there is updating the model weights, because you have to generate hundreds of possibilities And then, oh, you only train on a couple of them, right?”
Dylan Patel Dec 23, 2024 ▶ 39:14 AI Semiconductor Landscape feat. Dylan Patel | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
Dec 23, 2024 neutral
Insight
Patel: NVIDIA's inference moat relies on hardware rather than software
“NVIDIA's moat in, in inference is actually A lot smaller on software but it's a lot bigger on, hey, they just have the best hardware.”
Dylan Patel Dec 23, 2024 ▶ 13:53 AI Semiconductor Landscape feat. Dylan Patel | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
Sep 26, 2025 bullish
Assertion Supported
Gerstner: Over 40% of NVIDIA's revenue comes from AI inference workloads
“Over 40% of your revenue today is inference.”
Brad Gerstner Sep 26, 2025 ▶ 0:40 NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner · Bg2 Pod
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 40 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.