model card
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Nov 6, 2024 by Mike Krieger · across every show →
Everything said about model card, oldest first
Nov 6, 2024
Krieger: AI benchmark evals often contain flawed ground-truth answers
“And some of these model these evals we've seen, like, even the golden answer, I'm like, I'm not sure a human would say it, or, like, I think that math is actually a little wrong, like, getting a hundred percent is gonna be really hard, because even just gradin…”