robots.txt

3 statements across 2 episodes · 1 bullish · 2 bearish · 2 people on the record · first statement Mar 31, 2025 by Guy Tytunovich · said 2 times in 1 episodes since 2025 · across every show →

Mentions by year

brought up most by Guy Tytunovich (2)

mentionsepisodesper episode tap a year for its mentions

2025 2 mentions in 1 episode

The Secret Problem With AI Agents and How To Solve It — With Guy Tytunovich Mar 31, 2025 · 2 mentions · from 13:23
every mention in 2025, scene by scene →

every mention, scene by scene, with the transcript →

Everything said about robots.txt, oldest first

Mar 31, 2025 bearish

Prediction Not checkable as stated

Tytunovich: Self-Declared AI Signatures Will Create Major Security Loopholes

“There's a very high likelihood, in my opinion, that the proprietors behind the main AI agents, like OpenAI, like Google, would find a way to declare an AI agent as one operating on their behalf. That being said, that is the very definition of a loophole. Such …”

Guy Tytunovich Mar 31, 2025 ▶ 13:05 The Secret Problem With AI Agents and How To Solve It — With Guy Tytunovich

Aug 13, 2025 positive

Disclosure

Prince: Cloudflare working with IETF and regulators on robots.txt extensions

“And so what we've proposed, and we're working with the IETF as well as regulators is extensions to robots.txt to give it that granularity.”

Matthew Prince Aug 13, 2025 ▶ 36:59 Can We Save The Web From AI? — With Cloudflare CEO Matthew Prince

Aug 13, 2025 negative

Assertion Supported

Prince: Major legitimate companies completely ignore robots.txt

“And there's some just, there's some, even some big legitimate companies that completely ignore robots.txt.”

Matthew Prince Aug 13, 2025 ▶ 34:59 Can We Save The Web From AI? — With Cloudflare CEO Matthew Prince

robots.txt

Mentions by year

Everything said about robots.txt, oldest first

Turn any episode into a week of clips.