Exam Like Benchmarks
topic on 1 show · 1 statements across 1 episodes
the Y Combinator Startup Podcast
1 statements about Exam Like Benchmarks, every show
Chollet: Human exam benchmarks cannot measure progress toward AGI
“And that's the reason why using exam-like benchmarks with AI models is a bad idea. They're not going to tell you how close we are to AI. Because human exams weren't designed to measure intelligence. They were designed to measure task-specific skill and knowled…”