SimpleQA
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Oct 14, 2025 by Nathan Labenz · said 4 times in 1 episodes since 2025 · across every show →
Mentions by year
brought up most by Nathan Labenz (4)
tap a year for its mentions
2025 4 mentions in 1 episode
Everything said about SimpleQA, oldest first
Oct 14, 2025 positive
Labenz: GPT-4.5 achieved 65% accuracy on SimpleQA versus o3's 50%
“The O-three class of models got about a 50% on that benchmark, and GPT 4.5 popped up to like 65%. So, in other words, it basically, of the things that were not known to the previous generation of models, it picked up a third of them.”