canary strings
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Feb 23, 2026 by Mia Glaese · across every show →
Everything said about canary strings, oldest first
Feb 23, 2026 negative
Glaese: Open-source benchmarks cannot use canary strings to avoid contamination
“There's like multiple avenues, but like the problems are sourced from open source repos. So it's not just like when we usually publish evaluations, we publish evaluations, and then we add canary strings to ensure that, you know, they are easily filtered out at…”