evaluation criteria
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Sep 28, 2024 by Eugene Yan · across every show →
Everything said about evaluation criteria, oldest first
Sep 28, 2024
Yan: LLM evaluation criteria cannot be determined without inspecting real outputs
“What they're saying is that it is impossible to completely determine good evaluation criteria without actually looking at LLM outputs. So essentially the point is you have to look at the data before you overcome evaluation criteria.”