Mike Merrill
2 statements across 2 episodes · 2 bullish · 0 bearish · 1 people on the record · first statement Oct 18, 2025 by Mike Merrill · across every show →
On the record as a speaker too: Mike Merrill's record, appearances and statements → this page counts the times other people say the name.
Everything said about Mike Merrill, oldest first
Oct 18, 2025 positive
Merrill: AI evals will shift to observing real jobs over 2-3 years
“I think like the future of evals does look much more like this is like observing people who are doing their real jobs and then translating those real jobs into a format that allows you to evaluate language models and harnesses on them. And it's probably going …”
Nov 8, 2025 positive
Merrill: Terminal-Bench team spent 300+ hours auditing 89 benchmark tasks
“So I estimate we've spent at least 300 hours digging through each one of these 89 tasks, trying to figure out whether or not they're broken, whether or not they're some way to cheat, whether or not they're reproducible, and really obsessing over quality while …”