exam-like benchmarks
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Jul 3, 2025 by François Chollet · across every show →
Everything said about exam-like benchmarks, oldest first
Jul 3, 2025 negative
Chollet: Human exam benchmarks cannot measure progress toward AGI
“And that's the reason why using exam-like benchmarks with AI models is a bad idea. They're not going to tell you how close we are to AI. Because human exams weren't designed to measure intelligence. They were designed to measure task-specific skill and knowled…”