inference cost
also referred to as: inference costs
3 statements across 3 episodes · 1 bullish · 1 bearish · 3 people on the record · first statement Aug 29, 2025 by Ari Morcos · across every show →
Everything said about inference cost, oldest first
Aug 29, 2025 bearish
Morcos: AI inference costs will skyrocket, penalizing oversized models
“The inference costs are going to skyrocket with these models. And if you use a general purpose model, then you constrain to say, hey, this model knows about everything, but now only do this one thing. That model is going to have a ton of parameters that do not…”
Oct 7, 2025 neutral
Jan 9, 2026 positive
Cameron: Inference economics incentivize larger, sparser AI models over dense architectures
“It's, I think, less about total parameters in many cases when thinking about inference costs and more around number of active parameters, and so there's a bit of an incentive towards larger, sparser models.”