AI evaluation benchmarks

1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Sep 25, 2025 by Jakub Pachocki · across every show →

Everything said about AI evaluation benchmarks, oldest first

Sep 25, 2025 negative

Assertion Not checkable as stated

Pachocki: Standard AI evaluation benchmarks are close to saturation

“One thing is that indeed for like these e-files that we've been using for the last few years, they're indeed pretty close to saturated.”

Jakub Pachocki Sep 25, 2025 ▶ 2:44 From Vibe Coding to Vibe Researching: OpenAI’s Mark Chen and Jakub Pachocki

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

AI evaluation benchmarks

Everything said about AI evaluation benchmarks, oldest first

Turn any episode into a week of clips.