inference cost
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Nov 9, 2023 by Arthur Mensch · across every show →
Everything said about inference cost, oldest first
Nov 9, 2023 neutral
Mensch: Pure scientific model performance ignores crucial runtime inference costs
“And if you want to push the performance, the pure performance of models, you don't care about inference because you, well, you are not going to use the model. You're just going to see whether they're good or not. And that's really for scientific purposes. But …”