Matei Zaharia
Co-Founder and CTO, Databricks. On 3 shows, 3 appearances. The Shows tab opens the full record on each.
founderexecutiveacademicscientistengineer@matei_zaharia ↗LinkedIn ↗profiles.stanford.edu/matei-zaharia ↗Wikipedia ↗
Matei Zaharia created Apache Spark during his Ph.D. at UC Berkeley and co-founded Databricks. He has also co-developed open-source technologies such as MLflow and Delta Lake, earning the ACM Prize in Computing.
3shows
3appearances
43statements
7resolved
6supported
1contradicted
86%fully supported
12said about them ↓ Everything Matei Zaharia said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Zaharia: Model quality experiences diminishing returns from parameter scaling
“And also there's usually, there are usually diminishing returns from scale in, in terms of quality of models in general. And you can also kind of see it in other areas, like in computer vision, for example, we don't have, you know, trillion parameter models.”
Zaharia: Open agent hosting layers will win over proprietary alternatives
“Another way to think about it is like, imagine, you know we, our thing wasn't open. We had some kind of agent hosting thing, but it's not open. And then there is an open one. If you're, which one's gonna win in the long run? So like here, because there is this…”
Matei Zaharia: AI agents need stateful contextual security policies, not binary permissions
“A lot of coding agents today have very basic things like you can tell me which tool patterns I'll allow or disallow or whatever. It's like yes or no, but that puts you in a very tough spot. So just as an example, like, should my agent be able to read, you know…”
Zaharia: Scaling down from bulk ingestion to serving is easier than scaling up
“It turned out that, you know, it's easier to go from that bod thing that's really good at the scale and ingesting and super low cost and create versions in it that have the speed and features of the, you know, super easy to use, like smaller data for business …”
Zaharia: 6B parameter models can achieve instruction following with 50x less data
“We just had a larger data set of, you know, human-like conversations, and we had this you know, very kind of modest size open source model that's only six billion parameters, only trained on less than one terabyte of text. So like, 50 times less data than GPD …”
Zaharia: Small models excel at creative generation but struggle with factual recall
“It's surprisingly good at just freeform, like kind of fluent text generation. So you can tell it to like create a story or create a tweet or create a scientific paper abstract, and it does a pretty good job at that. And before that, whenever I talked to my, yo…”
Zaharia: Core LLM technology is commoditizing rapidly and becoming much cheaper
“The thing I can say for sure, especially, and Dolly and like other, you know, results like this really highlighted is it does seem that the core tech is getting commoditized very quickly. So just, if you just want to run, you know, something like today's chat …”
Zaharia: Linear token generation is inadequate for complex reasoning and planning
“This kind of token by token generation we're doing now is not an amazing format for reasoning because you have to like linearly, like do one, say one thing at a time. So it's not really good for like making plans or comparing versions. I think to get a really …”
Zaharia: Trillion-parameter models are computationally inefficient for knowledge retrieval
“I think actually, I think from a computation perspective, it's very inefficient to have like a trillion parameters and have to actually load them all and add and multiply by them. Each time you make an inference, because they're just encoding knowledge, most o…”
Matei Zaharia: Every software engineer will become an ML and data engineer
“And I think over time, like I increasingly think that basically, especially because of the capabilities of these AI models, every software engineer will need to become an ML engineer and a data engineer also. As they build their application and we'll, we'll fi…”
Zaharia: AI agents are useless without a collaboration and history layer
“Plus the agent is like completely useless if you can't share sessions with someone and have history and have search and all this like layer on top of it for collaboration.”
Zaharia: Databricks abandons frontier AI models to focus on agent systems
“Even though we did launch open source model DBRX, and, you know, we went up to, like, sort of above the LAMA-R III scale, we decided that we really want to focus on, there'll be so many people releasing models, and instead of doing the general model where, lik…”
Zaharia: Grounding LLMs with external vetted data fixes stale knowledge and hallucinations
“The two big problems with it are number one, like the knowledge is not up to date. You know, it's only, it only knows stuff it was strained on. And number two, a lot of the things it says are inaccurate and it's confident, but like wrong in various ways. And I…”
Zaharia: Reducing hallucinations may be easier with small models than big ones
“It may actually be easier with small models than with big ones to reduce hallucination from them, but it, you know, I think it's still an open question”
Zaharia: ChatGPT-level AI models will soon run locally on smartphones
“At least to get something with today's capabilities, I think it'll be you know, it'll be very affordable and you might just be able to run it locally on, you know, your phone or something.”
Zaharia: Data-rich enterprises may become model and data vendors
“And I think, I actually think even a lot of the enterprises that like have a lot of the data and various domains might turn more into data or model vendors of some form in the future you know, as they use this to like build something that no one else can.”
Zaharia: Coding agents and custom agents share identical underlying technical problems
“They're like, why are you doing coding agents and custom agents in the same thing, but I said it's basically the same problems.”
Zaharia: Protocol design remains essential for multi-party interoperability despite fast coding
“For this type of interoperability where multiple parties that are moving at different speeds are building stuff and you still want some layer on top to coordinate you do want to design it and build it. So it reminds me of that, like agents talking to each othe…”
Zaharia: Prototyped AI agents stall when security teams block internal data access
“That's where we've seen a lot of other agents like hit things like people think they prototyped an awesome agent, but you know, it's not allowed to connect to like some really important data or whatever because of the, Security team.”
Zaharia: Software with integration network effects should be open source
“One, so, I mean, one of the reasons to open source something is if you think it's a layer that will actually, there'll be some network effect. It'll benefit from many people collaborating on it.”
Zaharia: Databricks gives internal developers unlimited AI token spend
“It's unlimited, but we do you know, we use our own product to like analyze the traces and stuff, and we have a team that's, you know, looking to optimize and to see if anyone's doing something weird.”
Zaharia: Databricks' document vision model is ~100x cheaper than frontier models
“Our team built this document sort of vision model that takes a page and gives you back a nice JSON with all the components. And it's very competitive. It's like probably like a hundred X cheaper than those frontier models and still better.”
Zaharia: Customizing AI models will get significantly easier over time
“My feeling is, like customizing models is actually going to get way easier over time. That's what we're finding, because The base models are smarter, so they generate better traces in RL already, and then RL is about learning from your own past traces, and the…”
Zaharia: Databricks created Dolly by cloning Stanford's Alpaca approach
“Dolly is partly based on this great result from some other faculty members at Stanford called Alpaca, where they tested a way to, you know, basically they use the model to generate a bunch of realistic conversations, and then they use this to train another mod…”
The other half of the tape: Matei Zaharia's own voice is left out of every number here. Other people bring the name up 12 times in 7 episodes across the shows. every mention, with the transcript →
Who brings them up most Ben Horowitz 3Jared Quincy Davis 2Sherwin Wu 1Sarah Guo 1Michael Franklin 1Ion Stoica 1Andy Konwinski 1Ali Ghodsi 1
Every mention by year
tap a year for its mentions
the a16z Podcast 6
Latent Space 3
No Priors 3
2025 7 mentions in 4 episodes 2 per episode
- Ben Horowitz and Ali Ghodsi: How to Run a $100 Billion Business
- [State of Research Funding] Beyond NSF, Slingshots, Open Frontiers — Andy Konwinski, Laude Institute
- DevDay 2025: Apps SDK, Agent Kit, MCP, Codex and why Prompting is More Important than Ever
- Beyond Leaderboards: LMArena’s Mission to Make AI Reliable
- every mention in 2025, scene by scene →
2024 4 mentions in 2 episodes 2 per episode
One line per show, most statements first. The link opens Matei's full record on that show: the calibration, argument clarity, speaking style and every statement made there.
| Show | Role there | Eps | Statements | Record | |
|---|---|---|---|---|---|
| NO PRIORSLEDGER | Co-Founder and CTO, Databricks | 1 | 16 | 100% 3/3 | full record on No Priors → |
| LATENT SPACELEDGER | Co-Founder and CTO, Databricks | 1 | 14 | — | full record on Latent Space → |
| a16zLEDGER | Co-Founder and CTO, Databricks | 1 | 13 | 75% 3/4 | full record on the a16z Podcast → |