Chroma

“And you know, one thing Chroma released this context rod paper recently about context utilization and the cloud models are actually the best at using kind of like longer context.”

“For many years running, Chrome has been the number one used project broadly, but also within communities like LinkChain and Llama Index.”

“I think, like, there's a few things that I think might be true about retrieval systems in the future. So, like, number one, they just stay in latent space, they don't go back to natural language.”

“Chrome is written in Rust. It's fully multi-tenant. We have, we use object storage as a key Assistance tier and, like, data layer for Chroma distributed in Chroma Cloud as well.”

“So I think generating QA pairs is really important for benchmarking your retrieval system, golden dataset. Frankly, it's also the same dataset that you would use to fine tune in many cases. And so, yeah, there's definitely something like very underrated there.”

“So far we've still not found that really any AI coding tools are particularly good at rust though.”

“And obviously I'm incredibly proud that it exists today and that it's like serving hundreds of thousands of developers and they love it, but it was hard to get there.”

“Most companies are practically apprenticeships. Like every new employee who joins the team, like you spend one to three months, like wrapping them up. All that tested knowledge is not written down.”

“So, so, better databases, like, at that time, and even now, except a few, like, TurboPuffer and Chroma, Were not really scalable for the scale I was getting to where they were either getting too slow or too expensive to run.”