METR

includes METR Eval

3 statements across 3 episodes · 2 bullish · 1 bearish · 3 people on the record · first statement Oct 2, 2025 by Sholto Douglas · said 3 times in 2 episodes since 2026 · across every show →

Mentions by year, the whole family

brought up most by Matt Turck (3)

tap a year for its mentions
0021322026episodesmentions
0122026episodes it came up in
000.811.522026episodesmentions per episode
2026 3 mentions in 2 episodes 2 per episode

every mention, scene by scene, with the transcript →

Everything said about METR, oldest first

Oct 2, 2025 bullish
Assertion Supported
Douglas: AI autonomous task execution time horizons double every six months
“And so I think it's like every couple of months, the time horizon that the AIs are capable of doing is doubling or something, something crazy. Maybe, maybe every six months the time horizon doubles”
Sholto Douglas Oct 2, 2025 ▶ 40:13 Sonnet 4.5 & the AI Plateau Myth — Sholto Douglas (Anthropic)
Jan 15, 2026 positive
Assertion Supported
Izmailov: Duration of tasks AI can robustly automate doubles every six months
“There is this famous meter plot, which shows how long of a task AI is capable of robustly automating, and it's been kind of consistently doubling at that time every half a year, I think and it's now in like some hours so maybe a couple hours.”
Pavel Izmailov Jan 15, 2026 ▶ 31:04 The Evaluators Are Being Evaluated — Pavel Izmailov (Anthropic/NYU)
Aug 5, 2026 negative
Opinion
Trojanowski: METR AI Agent Benchmark Is Inaccurate With a Low Bar
“I think the meter chart is somewhat inaccurate these days because it's so hard to measure. And also the bar is pretty low, right? The bar is pretty low. Yeah, yeah. The bar is pretty low, and I think, I'm not super familiar with their dataset, but my understan…”
Mitch Trojanowski Aug 5, 2026 ▶ 20:48 How to Build Autonomous, Long-Horizon AI Agents | Basis
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.