Emmons: Swept was founded after an AI agent harmed teenagers
Shane Emmons · Building Trustworthy AI: Navigating the Challenges and Future of Agentic Software with Shane Emmons · Nov 4, 2025 · at 1:57
Shane Emmons, founder and CEO of Swept, discusses the founding origin of his AI trust and security company.
0:00 / 0:16exact quote · 16.5s
720p mp4 · rendered on demand · StarZero watermark
“I mean, we originally were started because we saw an AI agent perform some pretty bad harm to some teenagers that were trying to seek help. And that's where we were like, well this is going to be a common pattern. So let's make sure it doesn't go that way.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Shane Emmons
Emmons: Prompt guardrails fail to reliably constrain AI agents
“So stepping in there with policy that says do not go on this, that's a big deal for things in the medical setting where you may have, you know, people use the word guardrails to talk about AI where they're like, we're going to put guardrails so it doesn't do t…”
Emmons: Secure underlying APIs instead of trusting AI tool calls
“If somebody can ask the agent to make arbitrary tool calls, you really just need to make sure that those APIs and systems it's calling are properly secured versus trusting the AI is only going to make the right calls there.”
Emmons: AI ROI comes from agents doing work, not handbook copilots
“And that's where they're bringing ROI. It's not in co-pilots to ask information about your handbook. It's about agents actually doing work for your team.”
Emmons: Requiring humans to review every AI output eliminates ROI
“If a whole, if a human's now tasked with reviewing everything, we find a lot of times say you're doing a claims adjustment or underwriting an insurance place capacity, you would have where you're not making the value back because the person that's checking it …”
Emmons: AI's Probabilistic Imperfection Is a Benefit, Not Just a Limitation
“AI is meant for predicting things where we don't have perfect knowledge, and so that's just a fundamental, you can see it as a limitation, but you also can see it as really, I think of it as a benefit of AI, because there are all kinds of algorithms that We co…”
Emmons: Test AI at the scoped agent level, not foundation models
“When we're testing them and trying to figure out how they function, one of the first things we do is we don't go down to the model level, the chat GPDs, the clods, the Geminis of the world, because they have You can think of it as, like, infinite possibility. …”