Pairwise Preferences
topic on 1 show · 1 statements across 1 episodes
1 statements about Pairwise Preferences, every show
Yan: Pairwise evaluation fails for objective metrics like factuality
“The reason why pairwise preferences cannot work is that if you give two things that are both factual or if you give two things that are both non-factual, you would say that one is better than the other, but it still doesn't meet the bar of being factual enough…”