generative model performance
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Nov 1, 2024 by Anastasios Angelopoulos · across every show →
Everything said about generative model performance, oldest first
Nov 1, 2024 negative
Angelopoulos: Static benchmarks are intrinsically unable to evaluate generative models
“Static benchmarks are intrinsically, to some extent, unable to measure generative model performance. And the reason is because you cannot Pre-annotate all the outputs of a generative model. You change the model. It's like the distribution of your data is chang…”