HELM benchmark
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Feb 1, 2025 by Karina Nguyen · across every show →
Everything said about HELM benchmark, oldest first
Feb 1, 2025 negative
Nguyen: Stanford HELM benchmark under-reported Claude performance due to improper prompting
“This has happened with, like, Stanford, I remember, like, when Stanford had lists also, like, they were, like, running benchmarks. Yeah, Helm. And somehow, like, Claude was, like, always, like, not performing well, and that's because, like, the way they prompt…”