inference cost

also referred to as: inference costs

1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Aug 18, 2026 by Ben Thompson · across every show →

Everything said about inference cost, oldest first

Aug 18, 2026 bearish
Assertion Not checkable as stated
Thompson: Chinese open models like Kimi have high marginal inference costs
“You still have to run inference like GLM or Kimi. Kimi is very expensive to serve. The cost per answer is significantly higher.”
Ben Thompson Aug 18, 2026 ▶ 6:25 What Happens When the AI Boom Runs Out of Money · Invest Like The Best
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 60 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.