Chatbot Arena
3 statements across 1 episodes · 3 bullish · 0 bearish · 1 people on the record · first statement May 29, 2025 by Anastasios Angelopoulos · said 1 times in 1 episodes since 2026 · across every show →
Mentions by year
brought up most by Simon Moe (1)
tap a year for its mentions
2026 1 mention in 1 episode
Everything said about Chatbot Arena, oldest first
May 29, 2025 positive
Angelopoulos: LMArena prompt router yields double the performance per dollar
“Now, if you trace the performance, the best performance that, you know, any individual model can give you as part of the router as a function of cost. That's like two X worse than the router. In other words, the router is giving you double the bang for your bu…”
May 29, 2025 positive
Angelopoulos: Chatbot Arena is immune to model overfitting by design
“Static benchmarks overfit. Why? It's because as Jan said earlier, you're giving the student the same test over and over. You have a model, you test it, you know, you look at whether or not it's improved on a static data set. Then you find another model, you te…”
May 29, 2025 positive
Angelopoulos: LMArena router model outperforms all constituent models on Chatbot Arena
“When you train a prompt to leaderboard model, which is like, let's say a seven billion parameter model, and then you use it to route on just questions on the arena and everybody's questions, that model does better than any of the constituent models that were u…”