LMSYS Leaderboard
part of LMSYS
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Mar 6, 2024 by Soumith Chintala · across every show →
Everything said about LMSYS Leaderboard, oldest first
Mar 6, 2024 negative
Chintala: LMSYS leaderboard is biased and misses major use cases
“The LLSS leaderboard is the best thing we have right now to understand whether a model is better or not versus another model, but it's also biased and only having a sliver of view into how people actually use these models. Like, the people who actually end up …”