Handing AI Failures to Tier-Two Support Fails Without Closed Feedback
“Most of these agentic systems in production right now, like large scale agentic systems, usually if an agent hits a wall or can't perform anymore, it'll like send the, this case or this customer to a tier two support and forget about it. That doesn't really wo…”
Meiring: Client-facing AI output requires human verification, internal research does not
“A research document, you don't really need human in the loop too much because it's just an internal document. But when you turn that research and run it all the way through that process to the point where it becomes that capability pitch document that's beauti…”
Robin Rombach: Most Valuable AI Video Uses Require Human-in-the-Loop
“But I think ultimately. Like the real interesting use cases, they come when you have like a human in the loop who iterates and uses it as a medium.”
Srinivasa: Erie Insurance will always keep humans in the AI loop
“Insurance is a trust business. We will always have a human in the loop, ok? Because trust is built based on human intelligence and et cetera, and we want somebody to validate it.”
Mike: AI can replicate sauce but cannot create sauce
“When you and I are trying to use AI to build something meaningful, I hundred percent stand in the fact that the human still needs to be in the loop. AI can replicate sauce. It can't create sauce.”
Human-in-the-loop oversight will fail as AI agent actions scale exponentially
“Things that we thought might be useful in the past, like A human in the loop. Now that you're going to have a hundred X, a thousand X, a million X of these actions, that's not going to work.”
Kaufman: Falling Valuations Will Force Companies to Automate Workflows
“We are now seeing a significant reduction in stock prices, which will force companies to be more efficient and Try to remove the human in the loop as much as possible.”
Willison: Human-in-the-loop AI safety requires filtering requests to high-risk actions only
“Human in the loop helps a little bit, but if you ask the human to click, okay, five times a minute, they'll just click. Okay. All the time. If you can filter it down. So the human only gets asked on the high risk activities. That's how you build a sort of A pe…”
Ambrose: Human-in-the-loop oversight will persist in enterprise software for a long time
“I like, so I think it's a long time before human in the loop goes away. I think maybe there are some edge cases where this works.”
Andrusko: Ordinary Users Will Demand Human Approval Almost 100% of the Time
“The ordinary user will still want that last mile approval almost a hundred percent of the time. They will want the human part of the human in the loop to be the final decision maker.”
Schulhoff: Frontier labs will build fully autonomous systems, sidelining human-in-the-loop safety
“What people want is AIs that just go and do stuff. Like just go, just get it done. I don't want to hear from you until it's done. Like that's what people want. And like, that's what the market and the AI companies, the frontier labs will eventually give us. An…”
Nelson: Last-mile computer vision requires aligning intention, not knowledge
“And so this is why, like, in some ways human in the loop, because identifying human intention, not necessarily human knowledge is what's going to be important for a lot of last mile use.”
Windley: Human-in-the-loop is the optimal AI agent architecture today
“We've designed our application to make sure the human is still in the loop, so the recruiter or the user, because of, for qualitative checks, right, and judgment calls, we believe that's the best state of design for AI applications and AI agents today”
Martin: Agent memory pairs best with human-in-the-loop feedback
“Memory pairs really well with human in the loop. So for example, in my little email assistant, it's just an agent that runs my email, I have the opportunity to pause it before it sends off an email and correct it if I want, like, change the tone of this email,…”
Rob Howard: AI automations do not require complex integrations to deliver ROI
“You don't even need it to be a super fancy automation because the amount of time that's being saved, even with the final copy step, and you want the human in the loop anyway, to do that review, you're still saving such a huge amount of time that it's worth it …”
LaRue: Human SDR Responses Must Match AI Outbound Quality and Speed
“If you're going to be the human in the loop and respond, you got to do it one right away and it's got to be good. Like, it's gotta be at the same level as the AI, or they're gonna be like, oh, was this just a bad AI email that I got?”
Puri: Human data labeling will become obsolete in 7-10 years
“Like, you know, this might be a business that I think in, like, seven to 10 years, you may not need this anymore. Like, it seems like the way AI is going, you may not need this kind of human in the loop to label all this data.”
Marquez: AI Improvements Will Never Eliminate Human-in-the-Loop Oversight
“I would anticipate in time that we see an improvement, but that it will never necessarily eliminate the need for a human in the loop because it can be difficult to discern intent, and so you need someone to QA results.”
Nanavati: Legal AI requires the provider, not the customer, in the loop
“Generally when AI products sell human in the loop, what they're selling is the customer becomes the human in the loop, which is the customer still self-servicing the AI, which may make sense in a lot of, in legal industry, customer generally doesn't know what …”
Weisbrot: Human-in-the-Loop Services Command Higher Prices Than Self-Serve SaaS
“I think you can make a lot more money a lot faster because you could charge more by having that human in the loop to provide the service.”
Hoffman: Pure AI branding fails in healthcare without strong human-in-the-loop architecture
“Obviously, initially, people aren't going to necessarily have a lot of trust for AI, so you brand trust AI, that doesn't work. You have to have humans in the loop in really strong ways and I think that's one of the things that's kind of pretty essential to do …”
Removing humans from the loop requires designing products without safety nets
“In order to get the human on loop, we had to be intentional about it. We had to start building around the fact that a human won't be there anymore.”