inference cost
also referred to as: inference costs
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Sep 5, 2025 by Gorkem Yurtseven · across every show →
Everything said about inference cost, oldest first
Sep 5, 2025 bearish
Consumer Demand for Top AI Models Has Increased Inference Costs 100X
“Instead of models getting cheaper, yes, maybe the running the same model got cheaper. But people trained much bigger models that are much more expensive to run now, and people expect to use the best model. So running inference in general, maybe a hundred X in …”