general benchmarks
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Mar 13, 2025 by Hamel Husain · across every show →
Everything said about general benchmarks, oldest first
Mar 13, 2025 negative
Husain: General benchmarks for LLM judges provide very little value
“I put very little value in benchmarks, like general benchmarks. It's has some value, but you know, what you really need to do is like measure it in your domain and see if that alum as a judge is more aligned than like an off the shelf LLM. And what I've found …”