Inference Compute Spending
topic on 1 show · 1 statements across 1 episodes
1 statements about Inference Compute Spending, every show
Steinberger: AI inference spending will follow an extreme power-law distribution
“There'll be users who will want to spend less money, and users will want to spend more money, and this is likely going to follow some sort of very sort of spiky distribution, where there'll be like four users spending a million dollars, and, you know, four bil…”