SimpleQA, every mention
2 scenes · ← back to SimpleQA
tap a year for its mentions
every year anyone Nathan Lambert 3Shawn Wang 1
Verbatim, from the transcripts: the passages where SimpleQA comes up
The RLVR Revolution — with Nathan Lambert (AI2, Interconnects.ai)
- ▶ 22:59 Nathan Lambert You look at all the evals from reasoning models, and one of the trends is that, like, um, simple QA numbers all drop. 3 times in the scene
The Agent Reasoning Interface: Claude, ChatGPT Canvas, Tasks, Operator — with Karina Nguyen, OpenAI
- ▶ 15:56 Shawn Wang And then OpenAI put out simple eval, then nobody uses that.