MMLU
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement May 15, 2024 by Dwarkesh Patel · said 2 times in 1 episodes since 2024 · across every show →
Mentions by year
brought up most by Dwarkesh Patel (2)
tap a year for its mentions
2024 2 mentions in 1 episode
Everything said about MMLU, oldest first
May 15, 2024 negative
Standard AI benchmarks like MMLU are becoming saturated and inadequate
“I mean, like, people will come out and say, here's what we got on MMLU and so on, but they're getting saturated, and they're not, often not that great to begin with, so I, I'm more eager to see what it feels like to talk to one of these things than learn what …”