UI evaluation
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Oct 19, 2024 by Jesse Hu · across every show →
Everything said about UI evaluation, oldest first
Oct 19, 2024 negative
Hu: Evaluating UI correctness in SWE-bench Multimodal is highly subjective
“Zooming out, if you're true to try to judge whether a UI is correct, it's like extremely subjective. It might be iterative. It might be, you know, I have to interact with it first to get it right. So I'm super curious to see how they actually do the judging cr…”