Terminal-Bench 2.0

part of Terminal Bench

3 statements across 1 episodes · 3 bullish · 0 bearish · 1 people on the record · first statement Nov 8, 2025 by Mike Merrill · said 6 times in 1 episodes since 2025 · across every show →

Mentions by year

brought up most by Mike Merrill (4)

tap a year for its mentions
0031612025episodesmentions
0112025episodes it came up in
0030.5612025episodesmentions per episode

every mention, scene by scene, with the transcript →

Everything said about Terminal-Bench 2.0, oldest first

Nov 8, 2025 positive
Assertion Not checkable as stated
Merrill: Terminal-Bench team spent 300+ hours auditing 89 benchmark tasks
“So I estimate we've spent at least 300 hours digging through each one of these 89 tasks, trying to figure out whether or not they're broken, whether or not they're some way to cheat, whether or not they're reproducible, and really obsessing over quality while …”
Mike Merrill Nov 8, 2025 ▶ 4:32 Terminal-Bench 2.0: the most impt coding agent benchmark of 2025 gets a v2! Launch + Q&A w/ founders
Nov 8, 2025 positive
Assertion Not checkable as stated
Terminal-Bench 2.0 tasks are based on real paid workflows
“Every task in the benchmark is based off of real work that people do out in the world and are paid for.”
Mike Merrill Nov 8, 2025 ▶ 4:20 Terminal-Bench 2.0: the most impt coding agent benchmark of 2025 gets a v2! Launch + Q&A w/ founders
Nov 8, 2025 positive
Assertion Supported
Merrill: Terminus-2 harness yields highest agent performance on Terminal-Bench 2.0
“Terminus-II, which is our harness for measuring language models, is the highest performing agent for many of these models.”
Mike Merrill Nov 8, 2025 ▶ 6:10 Terminal-Bench 2.0: the most impt coding agent benchmark of 2025 gets a v2! Launch + Q&A w/ founders
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.