Chatbot Arena, every mention

11 scenes · ← back to Chatbot Arena

tap a year for its mentions
0013225320242025episodesmentions
02320242025episodes it came up in
007.51.515320242025episodesmentions per episode

every year anyone Shawn Wang 9Alessio Fanelli 6Anastasios Angelopoulos 4Wei-Lin Chiang 3

Verbatim, from the transcripts: the passages where Chatbot Arena comes up

loading…

The Great Evals Debate — Ankur Goyal & Malte Ubl Dec 7, 2025 · 2 mentions

  • ▶ 27:51 Shawn Wang Uh, I think that's why like companies like Artificial Analysis, uh, LM Arena, these are, these are like the independents, like the new gardeners of like independent reading agencies for various companies. 2 times in the scene

The Agent Network — Dharmesh Shah, Agent.ai + CTO of HubSpot Mar 28, 2025 · 1 mention

  • ▶ 48:30 Alessio Fanelli Yeah, I invested in a company called E to B, which does code sandbox, and they powered the LM arena web arena.

2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents Jan 1, 2025 · 1 mention

In the Arena: How LMSys changed LLM Benchmarking Forever Nov 1, 2024 · 18 mentions

  • ▶ 1:33 Wei-Lin Chiang I'm a fifth year PhD student at UC Berkeley, uh, working on Chopper Arena these days doing crowdsourcing, BI benchmarking. 2 times in the scene
  • ▶ 2:13 Wei-Lin Chiang Chatbot Arena project was started last year in April, May, around that.
  • ▶ 8:14 Shawn Wang You guys also published MTBench as well, which is a static version, let's say of Chatbot Arena, right? 2 times in the scene
  • ▶ 9:08 Shawn Wang Obviously when you offer effectively free A-B testing inference for people, people will come and use your arena. 3 times in the scene
  • ▶ 21:49 Anastasios Angelopoulos For example, it'd be great if we could execute code within Arena. 4 times in the scene
  • ▶ 29:05 Shawn Wang ELO on LMSYS or chatbot arena, and they, they released the best one, right?
  • ▶ 37:56 Alessio Fanelli As we wrap, can we just talk about LMSIS, and what that's going to be going forward, and like, LM Arena becoming its own thing? 5 times in the scene

Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI Mar 6, 2024 · 3 mentions

  • ▶ 1:18:47 unnamed speaker Um, the two leading candidates in my mind are LMSys out of UC Berkeley, um, who have the LMSys arena, which, um, you know, is being touted as one of the only ways, only reliable benchmarks anymore. 3 times in the scene
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.