Chroma co-founder Jeff Huber argues that enterprise needs like privacy, continuity, and cost make open-source models preferable to closed APIs.
Insight
Huber: LLMs are like CPUs, not operating systems
“I don't think of an LLM as an operating system. I think an LLM is much more like a CPU, right? It's an information processing unit.”
Insight
Huber: Open-source models win B2B through developer focus, not beating GPT-5
“Focus on the developers. I think that's the beachhead. That's how you win the B to B market. If you win the B to B market with your open source models, Like, you get all of the sort of downstream effects that you want. You know, you don't need to beat you know…”
Assertion Not checkable as stated
Huber: 10x compute increases are not producing 10x better AI models
“Diminishing, they're clearly diminishing marginal returns, right? We're sort of spending 10 X on compute. We're not getting 10 X or better models, at least evidently not yet.”
Prediction Not checkable as stated
Huber: AI will probably drive GDP growth exceeding the Industrial Revolution
“It's a, you know, technology is probably as important as the invention of electricity. It will probably, you know, bring about a increase in GDP that is on the order of the industrial revolution or greater.”
Prediction Not checkable as stated
Huber: In 10 years, the poorest could have better healthcare than today's billionaires
“Like it is very possible the poorest people on earth today, or, you know, in 10 years, we'll have access to better healthcare better legal representation you know, better financial services than, like, billionaires have today.”
Insight
Huber: Language models require a multi-tiered memory hierarchy like traditional computers
“In the same way that we have a memory hierarchy in classic computers, right, we have the CPU, RAM, disk, and network we are also going to have a similar memory hierarchy in language models. And again, it already exists today. We have the actual sort of transfo…”