SimpleQA
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jul 31, 2025 by Nathan Lambert · said 4 times in 2 episodes since 2025 · across every show →
Mentions by year
brought up most by Nathan Lambert (3), Shawn Wang (1)
tap a year for its mentions
Everything said about SimpleQA, oldest first
Jul 31, 2025 neutral
Lambert: SimpleQA benchmark scores drop across reasoning models tested without tools
“You look at all the evals from reasoning models, and one of the trends is that, like simple QA numbers all drop. It's like DeepSeq R-one to the new R-one, it goes down. It's like all the new, like, QN-II to QN-III, simple QA goes down, at least when you're eva…”