WebArena, every mention
5 scenes · ← back to WebArena
tap a year for its mentions
every year anyone Graham Neubig 6Shawn Wang 1Alessio Fanelli 1
Verbatim, from the transcripts: the passages where WebArena comes up
Why RL Won — Kyle Corbitt, OpenPipe (acq. CoreWeave)
- ▶ 30:54 Shawn Wang And then for just a reference job for more people, web arena is my first instance of this kind of thing where you literally have
The Agent Network — Dharmesh Shah, Agent.ai + CTO of HubSpot
- ▶ 48:30 Alessio Fanelli Yeah, I invested in a company called E to B, which does code sandbox, and they powered the LM arena web arena.
Best of 2024 in Agents (from #1 on SWE-Bench Full, Prof. Graham Neubig of OpenHands/AllHands)
- ▶ 19:08 Graham Neubig So there's this nice paper called step that got state of the art on the web arena web navigation benchmark where they came up with a bunch of manual workflows for solving different web navigation tasks. 2 times in the scene
- ▶ 22:47 Graham Neubig So for the web, we have something called Web Arena that we created at CMU.
- ▶ 25:21 Graham Neubig So, right now, we have WebArena and Sweebench. 3 times in the scene