Jeff Huber
Co-founder & CEO, Chroma. On 3 shows, 4 appearances. The Shows tab opens the full record on each.
founderexecutive
Jeff Huber is the co-founder and CEO of Chroma, an open-source vector database company. He works on AI-native infrastructure and search systems designed to scale with modern context requirements.
3shows
4appearances
57statements
3resolved
2supported
1contradicted
67%fully supported
11said about them ↓ Everything Jeff Huber said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Huber: Silicon Valley treats AGI as a secular religion
“I think AGI is also a religion. It has a problem of evil. We don't have enough intelligence. It has a solution, a deus ex machina. It has the second coming of Christ that AGI, the singularity is going to come. It's going to save humanity because we will now ha…”
Huber: Frontier models repeat mistakes if failed actions remain in context
“A few of the insights is, like, everyone, frontier model is not good at search. Humans have this natural explore-exploit trade-off, where we kind of understand, like, when to stop doing something. Also, humans are pretty good at, like, forgetting, actually, li…”
Huber: LLM Performance and Reasoning Degrade as Token Counts Increase
“The performance of LLMs is not invariant to how many tokens you use. As you use more and more tokens, the model can pay attention to less, and then also can reason sort of less effectively.”
Huber: LLMs will largely replace purpose-built re-rankers
“I think that, like, this is going to be the dominant paradigm. I actually think that, like, probably purpose-built re-rankers will go away, and the same way that, like, purpose-built, they'll still exist, right? Like, if you're at extreme scale, extreme cost, …”
Huber: Regex handles 90% of code queries; embeddings add marginal improvement
“My guess is that, like, for code today, it's something like, 90% of queries or 85% of queries can be satisfactorily run with regex. Regex is obviously, like, the dominant pattern used by Google code search, GitHub code search, but you maybe can get, like, 15% …”
Huber: Future retrieval systems will operate entirely within latent space
“I think, like, there's a few things that I think might be true about retrieval systems in the future. So, like, number one, they just stay in latent space, they don't go back to natural language.”
Huber: LLMs are like CPUs, not operating systems
“I don't think of an LLM as an operating system. I think an LLM is much more like a CPU, right? It's an information processing unit.”
Huber: Open-source models win B2B through developer focus, not beating GPT-5
“Focus on the developers. I think that's the beachhead. That's how you win the B to B market. If you win the B to B market with your open source models, Like, you get all of the sort of downstream effects that you want. You know, you don't need to beat you know…”
Huber: 10x compute increases are not producing 10x better AI models
“Diminishing, they're clearly diminishing marginal returns, right? We're sort of spending 10 X on compute. We're not getting 10 X or better models, at least evidently not yet.”
Huber: AI will probably drive GDP growth exceeding the Industrial Revolution
“It's a, you know, technology is probably as important as the invention of electricity. It will probably, you know, bring about a increase in GDP that is on the order of the industrial revolution or greater.”
Huber: In 10 years, the poorest could have better healthcare than today's billionaires
“Like it is very possible the poorest people on earth today, or, you know, in 10 years, we'll have access to better healthcare better legal representation you know, better financial services than, like, billionaires have today.”
Huber: Current SOTA LLMs Lack Reliability for Multi-Agent Workflows
“Now, of course, for those of you that have actually played with technology, I think it's questionable whether the current state of the art Language models, embedding models, et cetera, will give you the reliability you want from, ah, you know, agents working t…”
Huber: RBAC is dead and AI vendors are ignoring authorization
“Well, I'm just saying, I think, like, RBAC does seem to be dead, right? Like, if you want to say something is dead, probably RBAC is dead. And like the auth story to me seems like incredibly unsolved and unaddressed by like the existing state of like AI vendor…”
Huber: Frontier AI models are not actually good at agentic search
“We've like sort of stress tested like frontier models and their ability to search. And they are not actually that good at searching.”
Huber: Graph structures emerge dynamically in AI agents rather than schemas
“I think that the actual graph structure is emergent in the mind of the agent, ah, in the same way it is in the mind of the human. And that's a more powerful graph, because it actually evolved over time.”
Huber: Gradient-descent user feedback creates lowest-common-denominator products
“My critique of that would be that if you follow that methodology, you will probably end up building a dating app for middle schoolers, because that just seems to be like the lowest base take of what humans want to some degree.”
Huber: Successful AI Startups Fundamentally Excel at Context Engineering
“This is what, frankly, most AI startups, any AI stuff that you know of, that you think of today that's doing very well, like what are they fundamentally good at? What is the one thing that they're good at? It is context engineering.”
Huber: Consumer focus leaves LLM labs unmotivated to help developers
“Increasingly is the market to be a good LLM provider, the main market seems to be consumer. You're just not that motivated to, like, help developers.”
Huber: Flawless 60k-token reasoning is more valuable than 5M-token context
“I would rather have a model that has a 60,000 context, token context window, that is able to perfectly pay attention to, and perfectly reason over those 60,000 tokens, than a model that's like five million tokens. Like, just as a developer, the former is like …”
Huber: Offline compute driving continuous AI self-improvement is a sure bet
“Like, the idea that there's going to be, like, a lot of offline compute and inference under the hood that helps make AI systems continuously self-improve is a sure bet.”
Huber: No AI coding tools are particularly good at Rust
“So far we've still not found that really any AI coding tools are particularly good at rust though.”
Huber: Language models require a multi-tiered memory hierarchy like traditional computers
“In the same way that we have a memory hierarchy in classic computers, right, we have the CPU, RAM, disk, and network we are also going to have a similar memory hierarchy in language models. And again, it already exists today. We have the actual sort of transfo…”
Huber: Needle-in-a-haystack tests do not prove real-world long context reliability
“Even these, like, needle-in-a-haystack tests, like, are not actually that representative of, like, real-world utility and reliability of long context windows.”
The other half of the tape: Jeff Huber's own voice is left out of every number here. Other people bring the name up 11 times in 7 episodes across the shows. every mention, with the transcript →
Who brings them up most Lance Martin 2John Coogan 1Jo Kristian Bergum 1
Every mention by year
tap a year for its mentions
Latent Space 8
TBPN 3
2025 9 mentions in 6 episodes 2 per episode
- [State of Context Engineering] Agentic RAG, Context Rot, MCP, Subagents — Nina Lopatina, Contextual
- Context Engineering for Agents - Lance Martin, LangChain
- Weekly Recap: Apple Debuts iPhone 17, Einstein of Wall Street, YC Demo Day, Declining AI Adoption
- Weekly Recap: The Soham Parekh Drama, Meta Attacks OpenAI, Trump's Mega Bill
- Meta Poaches OpenAI Engineers
- The Rise and Fall of the Vector DB category: Jo Kristian Bergum (ex-Chief Scientist, Vespa)
- every mention in 2025, scene by scene →
2024 2 mentions in 1 episode
One line per show, most statements first. The link opens Jeff's full record on that show: the calibration, argument clarity, speaking style and every statement made there.
| Show | Role there | Eps | Statements | Record | |
|---|---|---|---|---|---|
| LATENT SPACELEDGER | Co-founder & CEO, Chroma | 2 | 26 | 50% 1/2 | full record on Latent Space → |
 MADLEDGER | Co-founder & CEO, Chroma | 1 | 16 | 100% 1/1 | full record on the MAD Podcast → |
| TBPNLEDGER | Co-founder & CEO, Chroma | 1 | 15 | — | full record on TBPN → |