StarZero All shows Try the podcast clipper →

inference cost

also referred to as: inference costs

2 statements across 2 episodes · 0 bullish · 1 bearish · 2 people on the record · first statement Aug 28, 2024 by Arvind Narayanan · across every show →

Everything said about inference cost, oldest first

Aug 28, 2024
Assertion Supported
Narayanan: Inference costs dominate training costs for popular AI models
“Over the lifetime of a model, when you have billions of people using it, the inference cost actually adds up, and for many of the popular models, that's the cost that dominates.”
Arvind Narayanan Aug 28, 2024 ▶ 15:33 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Jan 29, 2026 bearish
Prediction Open · timeframe Jan 2027
Lemkin: AI startups must model inference costs rising in 2026
“You need to model in your inference costs are going up this year, not down.”
Jason Lemkin Jan 29, 2026 ▶ 23:45 Anthropic Inference Costs Skyrocket |TikTok Deal Closes |The IPO Market:Wealthfront & EquipmentShare · 20VC with Harry Stebbings
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more