serious LMS
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jul 5, 2024 by Yi Tay · across every show →
Everything said about serious LMS, oldest first
Jul 5, 2024 neutral
Tay: Serious AI labs should never release their good evaluation benchmarks
“Serious LMS that create their own evals, and they, a good eval set is one that you don't release. A good eval set is the one that you, like, ok, you release some of it, but, like, it's like, you don't, like, you know, let it be contaminated by the community.”