web agents
4 statements across 3 episodes · 1 bullish · 0 bearish · 3 people on the record · first statement Oct 19, 2024 by Jesse Hu · across every show →
Everything said about web agents, oldest first
Oct 19, 2024
Jesse Hu: Realistic AI evaluation requires measuring multi-turn clarification, not single-turn fixes
“I think the broader thing is that the more and more realistic you get, the more you run into sort of like multi-turn or iterative things where now the task of the AI isn't just to just, you know, extract from your brain what the problem is and kind of directly…”
Dec 25, 2024 positive
Neubig: Web Agents Achieve Much Higher Accuracy Using APIs Over UIs
“We had a paper on API based web agents. And basically what we showed is if you take a web agent and the agent interacts not with a website, but with APIs, the accuracy goes way up just because APIs are way easier to interact with.”
Feb 28, 2025
Klein: Web agents still require human-in-the-loop workflows for CAPTCHAs and 2FA
“Web agents need human the loop type workflows still. You still need a person to interact with a browser and building a UI to proxy that is kind of hard. You may as well just show them the whole browser and say, Hey, can you finish this up for me? And then let …”
Feb 28, 2025 neutral
Klein: Agent loops belong at the application layer, making Stagehand a framework
“Stagehand isn't a web agent. It's a framework for building web agents. And we think that agent loops are actually pretty close to the application layer because every application probably has different goals or different ways it wants to take steps.”