external benchmarks
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Dec 18, 2025 by Sebastien Bourgeau · across every show →
Everything said about external benchmarks, oldest first
Dec 18, 2025 negative
Bourgeau: External AI benchmarks quickly become contaminated via web data
“What we found is that external benchmarks, then you can use them for a little while, but very quickly they become contaminated. So they start to be replicated on different forms Different forms or different parts of the web, and then if we end up training on t…”