LLM leaderboards
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement May 31, 2024 by Mark Huang · across every show →
Everything said about LLM leaderboards, oldest first
May 31, 2024 negative
Huang: Model merging is polluting open LLM leaderboards
“That is extremely interesting from the developer community, and I want to see more of it except it is, to a certain extent, kind of polluting the leaderboards these days, because it's so targeted, and like, now you can kind of game the metric by just finding a…”