StarZero All shows Try the podcast clipper →

MMLU-Pro

also referred to as: mmlu pro

1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Aug 3, 2026 by Philip Kiely · said 5 times in 3 episodes since 2024 · across every show →

Mentions by year

brought up most by Philip Kiely (1), Barak Lenz (1)

tap a year for its mentions
002131202420252026episodesmentions
011202420252026episodes it came up in
001.50.531202420252026episodesmentions per episode
2026 1 mention in 1 episode
2025 1 mention in 1 episode
2024 3 mentions in 1 episode

every mention, scene by scene, with the transcript →

Everything said about MMLU-Pro, oldest first

Aug 3, 2026 positive
Assertion Partly supported
Baseten's vision-retrofitted GLM-5.2 scored 56% on MMLU Pro without text degradation
“It's not, you know, it got to a 56% on MMLU Pro, I think, so not, not quite Frontier, but if you're running this model, you haven't suffered any loss on your GLM-Five-II quality.”
Philip Kiely Aug 3, 2026 ▶ 19:22 Next 100x in AI: Inference, Networking, & Self-Optimizing Models — Philip Kiely & Ali Taha, Baseten
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more