Chatbot Arena, every mention
11 scenes · ← back to Chatbot Arena
tap a year for its mentions
every year anyone Shawn Wang 9Alessio Fanelli 6Anastasios Angelopoulos 4Wei-Lin Chiang 3
Verbatim, from the transcripts: the passages where Chatbot Arena comes up
The Great Evals Debate — Ankur Goyal & Malte Ubl
- ▶ 27:51 Shawn Wang Uh, I think that's why like companies like Artificial Analysis, uh, LM Arena, these are, these are like the independents, like the new gardeners of like independent reading agencies for various companies. 2 times in the scene
The Agent Network — Dharmesh Shah, Agent.ai + CTO of HubSpot
- ▶ 48:30 Alessio Fanelli Yeah, I invested in a company called E to B, which does code sandbox, and they powered the LM arena web arena.
2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents
- ▶ 1:06:25 Shawn Wang I will also say LMSys, now LM Arena also has emerged this year as, as a,
In the Arena: How LMSys changed LLM Benchmarking Forever
- ▶ 1:33 Wei-Lin Chiang I'm a fifth year PhD student at UC Berkeley, uh, working on Chopper Arena these days doing crowdsourcing, BI benchmarking. 2 times in the scene
- ▶ 2:13 Wei-Lin Chiang Chatbot Arena project was started last year in April, May, around that.
- ▶ 8:14 Shawn Wang You guys also published MTBench as well, which is a static version, let's say of Chatbot Arena, right? 2 times in the scene
- ▶ 9:08 Shawn Wang Obviously when you offer effectively free A-B testing inference for people, people will come and use your arena. 3 times in the scene
- ▶ 21:49 Anastasios Angelopoulos For example, it'd be great if we could execute code within Arena. 4 times in the scene
- ▶ 29:05 Shawn Wang ELO on LMSYS or chatbot arena, and they, they released the best one, right?
- ▶ 37:56 Alessio Fanelli As we wrap, can we just talk about LMSIS, and what that's going to be going forward, and like, LM Arena becoming its own thing? 5 times in the scene
Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI
- ▶ 1:18:47 unnamed speaker Um, the two leading candidates in my mind are LMSys out of UC Berkeley, um, who have the LMSys arena, which, um, you know, is being touted as one of the only ways, only reliable benchmarks anymore. 3 times in the scene