Opinion
Huber: Current SOTA LLMs Lack Reliability for Multi-Agent Workflows
“Now, of course, for those of you that have actually played with technology, I think it's questionable whether the current state of the art Language models, embedding models, et cetera, will give you the reliability you want from, ah, you know, agents working t…”
Disclosure
Huber: Chroma is committed to remaining fully open source
“Chroma will always, we are committed to building the ubiquitous open source standard.”
Prediction Not checkable as stated
Huber: Vector databases must support both transactional and analytical workloads
“And we think that both certainly transactional has to be the case because it is a online database. It's gonna sit in the loop of applications. Again, you've already seen demos of this happening tonight. But also to make this technology useful for developers, y…”
Opinion
Huber: Asking whether vector databases replace classic databases is dumb
“People, there's this, like, you know, big question about, oh, are vector databases gonna replace classic databases? Are these competitive in some way? And I think it's just kind of a dumb question.”
Insight
Embedding search and analytics enable developers to improve model reliability
“By looking at embeddings doing embedding search, doing analytics over embedding space you could give developers you know, at the minimum of a divining rod, if not a compass, to be able to improve their models and get to the level of reliability they want to ha…”
Insight
Huber: Programmable memory enables reliable LLMs across all use cases
“Chroma's belief is that programmable memory, so developers being able to set terministically Hey, language model, this is the knowledge you should know about, this is the knowledge you should use, these are the tools you should know about, these are the tools …”
Prediction Not checkable as stated
Huber: 'Chat Your Data' AI Use Case Will See Mass Adoption
“So I think that use case, even just the Chat Your Data use case, truly will go to the ends of the earth.”
Assertion Supported
Huber: Steering LLMs at embedding layer is not exposed in closed-source models
“So, there's lots of stuff around steering language models at the embedding layer itself, and not using text but this is not yet exposed To at least closed source models, so.”
Prediction Not checkable as stated
Huber: AI-native databases will be much thicker than traditional databases
“We think the database will be, like, much thicker than it's been before.”
Prediction Not checkable as stated
Huber: Multimodal models will run directly inside application code and databases
“There'll be language models running inside the application code, obviously, language models running inside the database as well or large models more broadly, multimodal models will run, you know, everywhere as well.”
Prediction Not checkable as stated
Huber: Most enterprises will deploy language models within three years
“I certainly think probably most enterprises, organizations, companies on earth will have brought language models Into the company, probably in pretty meaningful ways. At minimum, the customer service department, the sales department, ops, back end, legal and h…”
Opinion
Huber: 'Vector database' is too narrow a term for information retrieval
“I don't actually like the term vector database that much. I think it's sort of narrow. I think the job to be done is information retrieval more broadly, and vector search happens to be a useful tool in our toolbox to doing information retrieval.”
Insight
Huber: Vector databases primarily handle un-databased unstructured data
“Vector databases are primarily about unstructured data. It's actually taking data that had no database that knew about it and loading it in for the very first time. Most applications of this stuff is not about taking data that's already in your relational data…”
Disclosure
Chroma is developing an open-source distributed version of its database
“We're working on a distributed version of Chroma. So in the same way that Elastic for those of you that are familiar with TextSearch, Elastic picked up Lucene, made it developer-friendly, they made it distributed, Chroma picks up some of these ANN algorithms, …”
Disclosure
Huber: Chroma is building density detection for vector space retrievals
“One of the things that we've been working on is this idea of query relevancy or density. So given retrievals, From vector space, given the search. We can say whether it came from a sparse or dense part of the embedding space.”
Disclosure
Huber: Chroma will not natively manage full human-in-the-loop workflows
“A database specifically, Chroma specifically, is not gonna do all of this workflow, obviously, and we're not gonna have, like, you know, user code for typing in answers.”
