public AI benchmarks

1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Sep 1, 2025 by Nick Frosst · across every show →

Everything said about public AI benchmarks, oldest first

Sep 1, 2025 negative

Insight

Frosst: Benchmark scores measure training dataset overlap rather than true model utility

“They're a reflection of how much the model had been trained on those benchmarks.”

Nick Frosst Sep 1, 2025 ▶ 17:29 Cohere Founder, Nick Frosst: How To Compete with OpenAI & Anthropic, and Sam Altman’s AI Disservice · 20VC with Harry Stebbings

Turn any episode into a week of clips.

This entire site, over 1,200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

public AI benchmarks

Everything said about public AI benchmarks, oldest first

Turn any episode into a week of clips.