Agentic Reasoning
topic on 1 show · 1 statements across 1 episodes
1 statements about Agentic Reasoning, every show
O'Driscoll: Aggregate AI Serving Costs Increase Despite Cheaper Per-Token Prices
“Price per token, price for all those metrics going down amazingly every year, but token consumption going up every year, because as these models do more agentic reasoning, the total compute cost of that goes up. So, so the net cost of serving the customer goes…”