Arcjet CEO David Mytton discusses web security challenges with a16z partner Joel de la Garza, explaining how modern automated bots and AI agents bypass traditional voluntary standards like robots.txt.
“And, but there are newer bots that are ignoring it or even sometimes using it as a way to find the parts of your site that you don't want it to access. And they will just do that anyway.”
quote is from the automated transcript, cleaned for reading:
filler sounds and stutters are removed, nothing is rephrased. names can be misheard
(the analysis reads context, assessments check outside sources). how →
More from David Mytton
AssertionSupported
Mytton: 50% of Current Internet Traffic Comes From Automated Bots
“50% of traffic is already bots, it's already automated”
David MyttonJun 16, 2025▶ 16:52AI is Revolutionizing Web Security - Bots, Agents, & Real-Time Defense
PredictionNot checkable as stated
Mytton: Web Traffic From Autonomous AI Agents Will Explode
“We're going to see an explosion in the traffic that's coming from these tools”
David MyttonJun 16, 2025▶ 17:08AI is Revolutionizing Web Security - Bots, Agents, & Real-Time Defense
Opinion
Mytton: Blanket Blocking of AI Traffic Is the Wrong Security Strategy
“Just blocking them just because they're AI is the wrong answer.”
David MyttonJun 16, 2025▶ 17:12AI is Revolutionizing Web Security - Bots, Agents, & Real-Time Defense
Insight
Mytton: E-commerce sites should flag suspicious transactions, not block them
“If you're running an e-commerce operation, an online store, the worst thing you can do is block a transaction because then you've lost the revenue. Usually you want to then flag that order for review.”
David MyttonJun 16, 2025▶ 2:59AI is Revolutionizing Web Security - Bots, Agents, & Real-Time Defense
AssertionNot checkable as stated
Mytton: DDoS protection has become a commodity handled by cloud providers
“The DDoS problem is still there, but it's just almost handled as a commodity these days. The network provider, your cloud provider, They'll just deal with it. And so when you're deploying an application, most of the time you just don't have to think about it.”
David MyttonJun 16, 2025▶ 0:53AI is Revolutionizing Web Security - Bots, Agents, & Real-Time Defense
Insight
Mytton: Non-DDoS web security requires application-level context
“So a volumetric DDoS attack, you just want to block that at the network. You never want to see that traffic, but everything else needs the context of the application.”
David MyttonJun 16, 2025▶ 2:26AI is Revolutionizing Web Security - Bots, Agents, & Real-Time Defense
Made with StarZero
Turn any episode into a week of clips.
This entire site, over 1,000 episodes transcribed, diarized, checked and made playable,
runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the
moments worth sharing, cuts them, captions them, and reframes them for every feed.
We use essential cookies to make the site work. With your permission we
also use analytics cookies (Google Analytics and Mixpanel) to understand
usage and improve StarZero. See our Cookie Policy.