inference
2 statements across 2 episodes · 0 bullish · 0 bearish · 2 people on the record · first statement Aug 3, 2023 by Matt Wood · across every show →
Everything said about inference, oldest first
Aug 3, 2023 neutral
Wood: Vast Majority of AI Compute Cost Is Inference, Not Training
“And whilst A lot of focus is put on training. If you think about it, you may train a model once a month, once a week, let's say, but you're going to be running predictions and inference and chatting with that model 100,010 of thousands of times a day. And so i…”