AI evaluation
2 statements across 2 episodes · 0 bullish · 2 bearish · 2 people on the record · first statement May 15, 2024 by Dwarkesh Patel · across every show →
Everything said about AI evaluation, oldest first
May 15, 2024 negative
Chatbot Arena fails to properly evaluate long-form conversational context
“And in fact, I think even chatbot arena has some deficiencies in terms of evaluation because from what I understand, you're doing these pairwise comparisons, but you're doing them you ask a question and two of them respond. And what I'm more curious about is w…”
Aug 26, 2026 negative