Everything Maxim Bar Kogan said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Human-in-the-loop oversight will fail as AI agent actions scale exponentially
“Things that we thought might be useful in the past, like A human in the loop. Now that you're going to have a hundred X, a thousand X, a million X of these actions, that's not going to work.”
Independent AI oversight will become a $100 billion market opportunity
“So I think it will be crucially important if you have AI companies that are 10 trillion dollar companies, we think you want a company that is not the vendor of the AI itself to oversee and help you control what AI is doing. And we think that's an opening that'…”
Smarter AI models will make mechanistic interpretability and tracking more effective
“But as we're starting to have models that are much smarter than us, at least in some important ways, we think that we'll be able to start tracking mechanistic capability much more effectively.”
Claude Code became the first widely used autonomous AI agent
“We had a cloud code, which became like the really first widely used autonomous agent.”
Anthropic revenue comes from enterprises replacing developers with Claude Code
“Like Anthropix revenue is coming from enterprises that are paying for cloud code to do a lot of the work that developers used to do.”
Autonomous AI agents recently caused enterprise downtimes and credential leaks
“We've seen some of that happen lately with downtimes that were caused by agents doing their own thing, agents accidentally publishing code and tokens that they weren't supposed to and so on.”
Autonomous coding agents make up over 50% of enterprise AI usage
“Of these categories, I would say roughly at this point, over 50% is the autonomous coding agents and assistants in the average enterprise. Then probably 45% is is those low code automations. And the last two percent are really the first party ones that they're…”
Autonomous agents are the fastest growing AI category but lack controls
“And so I think that today autonomous has by far the fastest growing category and today typically comes without any controls.”
Legacy security tools lack context to monitor autonomous AI agent systems
“A lot of these existing tools, they don't have the context to understand what these very flexible and predictable systems are doing.”
Proxy security architectures cannot secure modern distributed AI workloads
“There's a lot of systems where that's just not viable technically because AI today runs On the cloud, on someone else's infrastructure, on your endpoint, and just proxy is not always an option.”
AI security requires underwriting model intent rather than inspecting data traffic
“The hard problem is understanding if what I should do now. It turns out that in the case of AI systems, that is the hard question. Like, what is the engine that needs to underwrite these different actions and say if they're okay or not? And because We need to …”
Understanding model weights and activations is essential for AI safety
“We believe that understanding the internal weights and activations, what is the internal structure, the mathematical structure of these systems is going to be at least part of the solution.”
AI labs should broaden enterprise access to offensive security models
“I would really encourage that we expand The amount of companies that get access to this and make it much easier for people to get.”
Enterprises must assume offensive AI models are inevitable and invest now
“I would advise everyone to assume that these models are coming anyway. The only thing you can do right now is to invest in these foundational controls that will stop the downstream effects of these vulnerabilities are going to be found in their systems.”
Enterprises adopting diverse AI tools will outperform single-vendor adopters
“I personally think that The companies that are gonna do well are the companies that are gonna allow a lot of different tools because the landscape is changing so quickly. If you bet on OpenAI, here we go, that would have been the safest bet in the world, but s…”
Enterprises withhold historical AI agent data from OpenAI and Anthropic
“So for example, we're allowed to look at a lot of historical data of how these agents have behaved, but enterprises that are not willing to have Anthropic or OpenAI give that historical data because they know these are very data hungry companies that will want…”
Enterprise security teams and knowledge work will soon be run by agents
“I do think that security teams are also going to be, become completely high powered. And, but I do think that, you know, they're going to be run by AI agents and like everything else in, in kind of the knowledge workspace, I would, in the near future.”
Without specific controls, enterprises must choose between neutered AI or risk
“If you're not building some kind of controls that are built for these systems, then you're either gonna end up limiting them a lot, making them almost much less useful to the enterprise, or you're gonna miss a lot of pretty dangerous things that they might be …”
Supervising AI with 1:1 agents is a cost and latency dealbreaker
“Because if I need to run an agent for every agent you're running as your security vendor you're going to be paying for me More than you're paying for your AI, right? So it's not, it's pretty much a deal breaker. And also it's going to be so slow.”
Efficient AI systems concentrate compute overwhelmingly on high-risk decisions
“It's the efficient way to run a computation, right? You don't want to spend too much intelligence or you don't have to, and you want to spend a lot of intelligence, overwhelmingly a lot in situations where there's high risk.”
Enterprise security leaders prefer early startup risk over ignoring emerging threats
“At the end of the day, security people are in the business of revenue preservation. They understand that this is a, between the two risks, they want to partner with someone that's promising and early rather than not do anything.”
The market is not overreacting to automated AI vulnerability discovery tools
“I think that, first of all, the market is not overreacting. I think this is a huge change in what this means for security teams.”
Foundation model vendors will eventually eliminate basic AI mistakes directly
“I think that problem will go away. I think we're heading for much smarter models that make less silly mistakes and our role is not going to be to prevent silly mistakes. That will be taken care of by the model vendors because they're very incentivized to do it…”
Designing software for AI agents requires optimizing context tokens to prevent overload
“For a human, it might be not overwhelming them with too much information that is irrelevant. For an agent, it might be not wasting too many tokens in their context when we talk to them. And maybe it's the same thing, really.”