Prediction Not checkable as stated
Zaharia: Open agent hosting layers will win over proprietary alternatives
“Another way to think about it is like, imagine, you know we, our thing wasn't open. We had some kind of agent hosting thing, but it's not open. And then there is an open one. If you're, which one's gonna win in the long run? So like here, because there is this…”
Insight
Matei Zaharia: AI agents need stateful contextual security policies, not binary permissions
“A lot of coding agents today have very basic things like you can tell me which tool patterns I'll allow or disallow or whatever. It's like yes or no, but that puts you in a very tough spot. So just as an example, like, should my agent be able to read, you know…”
Insight
Zaharia: Scaling down from bulk ingestion to serving is easier than scaling up
“It turned out that, you know, it's easier to go from that bod thing that's really good at the scale and ingesting and super low cost and create versions in it that have the speed and features of the, you know, super easy to use, like smaller data for business …”
Insight
Zaharia: AI agents are useless without a collaboration and history layer
“Plus the agent is like completely useless if you can't share sessions with someone and have history and have search and all this like layer on top of it for collaboration.”
Disclosure
Zaharia: Databricks abandons frontier AI models to focus on agent systems
“Even though we did launch open source model DBRX, and, you know, we went up to, like, sort of above the LAMA-R III scale, we decided that we really want to focus on, there'll be so many people releasing models, and instead of doing the general model where, lik…”
Insight
Zaharia: Coding agents and custom agents share identical underlying technical problems
“They're like, why are you doing coding agents and custom agents in the same thing, but I said it's basically the same problems.”
Insight
Zaharia: Protocol design remains essential for multi-party interoperability despite fast coding
“For this type of interoperability where multiple parties that are moving at different speeds are building stuff and you still want some layer on top to coordinate you do want to design it and build it. So it reminds me of that, like agents talking to each othe…”
Insight
Zaharia: Prototyped AI agents stall when security teams block internal data access
“That's where we've seen a lot of other agents like hit things like people think they prototyped an awesome agent, but you know, it's not allowed to connect to like some really important data or whatever because of the, Security team.”
Insight
Zaharia: Software with integration network effects should be open source
“One, so, I mean, one of the reasons to open source something is if you think it's a layer that will actually, there'll be some network effect. It'll benefit from many people collaborating on it.”
Disclosure
Zaharia: Databricks gives internal developers unlimited AI token spend
“It's unlimited, but we do you know, we use our own product to like analyze the traces and stuff, and we have a team that's, you know, looking to optimize and to see if anyone's doing something weird.”
Assertion Not checkable as stated
Zaharia: Databricks' document vision model is ~100x cheaper than frontier models
“Our team built this document sort of vision model that takes a page and gives you back a nice JSON with all the components. And it's very competitive. It's like probably like a hundred X cheaper than those frontier models and still better.”
Prediction Not checkable as stated
Zaharia: Customizing AI models will get significantly easier over time
“My feeling is, like customizing models is actually going to get way easier over time. That's what we're finding, because The base models are smarter, so they generate better traces in RL already, and then RL is about learning from your own past traces, and the…”
Disclosure
Zaharia: Databricks built Isaac as an internal wrapper for Claude Code and Codex
“We have a really great dev info team. They built something called Isaac that's basically like a wrapper on cloud code and codex and let's you use them either on the web and like, Sandboxes or just on your dev machine or on your laptop or whatever.”
Disclosure
Zaharia: Omnigent was built to allow teams to securely share custom agent setups
“We had a lot of engineers building, you know, their own Vibe coding setup. But then the other thing they all said is like, Hey, I built something that's amazing for me. But like no one else on the team can use it because I don't have a server to collaborate. A…”
Matei Zaharia