LM event harness
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Jul 5, 2024 by Yi Tay · across every show →
Everything said about LM event harness, oldest first
Jul 5, 2024 negative
Tay: Zero-shot benchmark scores at 1B model scale are random chance
“Every time some people propose like this, they run like some zero-shot score on like some LM event harness or something like that, and you know like at one B scale, all the numbers are random, basically. Like all your bull kill, they're all like random chance …”