Chroma

“So, so, better databases, like, at that time, and even now, except a few, like, TurboPuffer and Chroma, Were not really scalable for the scale I was getting to where they were either getting too slow or too expensive to run.”

“Most companies are practically apprenticeships. Like every new employee who joins the team, like you spend one to three months, like wrapping them up. All that tested knowledge is not written down.”

“Chrome is written in Rust. It's fully multi-tenant. We have, we use object storage as a key Assistance tier and, like, data layer for Chroma distributed in Chroma Cloud as well.”

“And obviously I'm incredibly proud that it exists today and that it's like serving hundreds of thousands of developers and they love it, but it was hard to get there.”

“For many years running, Chrome has been the number one used project broadly, but also within communities like LinkChain and Llama Index.”

“I think, like, there's a few things that I think might be true about retrieval systems in the future. So, like, number one, they just stay in latent space, they don't go back to natural language.”

“So I think generating QA pairs is really important for benchmarking your retrieval system, golden dataset. Frankly, it's also the same dataset that you would use to fine tune in many cases. And so, yeah, there's definitely something like very underrated there.”

“So far we've still not found that really any AI coding tools are particularly good at rust though.”

“And you know, one thing Chroma released this context rod paper recently about context utilization and the cloud models are actually the best at using kind of like longer context.”

“Fuzzy search is really useful when people like are not, you know, experts in their own data, right? Is that if you're Google Drive, you know how to search for stuff pretty well, right? But like your users don't know how to search for the stuff that you've said…”

“We sort of came up with the solution before we knew the problem. And so we just, you know, just like, oh, we're going to intuit our way to a platform that solves all these problems. And so when we started to have those conversations with landlords, small and b…”

“People spending part of their days on chroma was like 17.”

“You know, that, that business model works, I think, only when capital is cheap, available, and rates are low.”

“We had been approved for a fifty million dollar line of credit at, for credit committee from a major bank contingent on a three million dollar equity raise.”

“The three questions we asked were, do we think this business model is rock solid? Do we think that we could actually, you know, we go through a downturn for 18, 24 months, 36, whatever it ends up being, and is Chroma a place that A players still want to work? …”

“Chroma's belief is that programmable memory, so developers being able to set terministically Hey, language model, this is the knowledge you should know about, this is the knowledge you should use, these are the tools you should know about, these are the tools …”

“We're working on a distributed version of Chroma. So in the same way that Elastic for those of you that are familiar with TextSearch, Elastic picked up Lucene, made it developer-friendly, they made it distributed, Chroma picks up some of these ANN algorithms, …”

“Chroma will always, we are committed to building the ubiquitous open source standard.”

“And we think that both certainly transactional has to be the case because it is a online database. It's gonna sit in the loop of applications. Again, you've already seen demos of this happening tonight. But also to make this technology useful for developers, y…”

“One of the things that we've been working on is this idea of query relevancy or density. So given retrievals, From vector space, given the search. We can say whether it came from a sparse or dense part of the embedding space.”

“A database specifically, Chroma specifically, is not gonna do all of this workflow, obviously, and we're not gonna have, like, you know, user code for typing in answers.”