MMLU
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Aug 22, 2024 by Jared Quincy Davis · said 5 times in 2 episodes since 2024 · across every show →
Mentions by year
brought up most by Jared Quincy Davis (3), Sarah Guo (1), Dan Hendrycks (1)
tap a year for its mentions
2025 2 mentions in 1 episode
2024 3 mentions in 1 episode
Everything said about MMLU, oldest first
Aug 22, 2024 positive
Davis: Compound AI approach yielded a 3% MMLU performance bump
“The MMLU performance bump was about three percent. And to put that in perspective, the gap between some of the previous best models is often less than one percent. Between, for example, Gemini, 1.5, and Lama 3.1, and things like that. So, actually, 2.8% or thr…”