why aren't all 9 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Prediction Not checkable as stated
Huber: Future retrieval systems will operate entirely within latent space
“I think, like, there's a few things that I think might be true about retrieval systems in the future. So, like, number one, they just stay in latent space, they don't go back to natural language.”
Opinion
Shah: Most vector databases become too slow or expensive at scale
“So, so, better databases, like, at that time, and even now, except a few, like, TurboPuffer and Chroma, Were not really scalable for the scale I was getting to where they were either getting too slow or too expensive to run.”
Opinion
Huber: No AI coding tools are particularly good at Rust
“So far we've still not found that really any AI coding tools are particularly good at rust though.”
Insight
Huber: Most companies operate as apprenticeships with unwritten tacit knowledge
“Most companies are practically apprenticeships. Like every new employee who joins the team, like you spend one to three months, like wrapping them up. All that tested knowledge is not written down.”
Assertion Supported
Huber: Chroma is the most used project across LangChain and LlamaIndex
“For many years running, Chrome has been the number one used project broadly, but also within communities like LinkChain and Llama Index.”
Insight
Huber: Synthetic QA pair generation is underrated for retrieval benchmarking
“So I think generating QA pairs is really important for benchmarking your retrieval system, golden dataset. Frankly, it's also the same dataset that you would use to fine tune in many cases. And so, yeah, there's definitely something like very underrated there.”
Assertion Partly supported
Chroma research finds Claude models lead in long-context utilization
“And you know, one thing Chroma released this context rod paper recently about context utilization and the cloud models are actually the best at using kind of like longer context.”
Disclosure
Huber: Chroma is written in Rust and uses object storage
“Chrome is written in Rust. It's fully multi-tenant. We have, we use object storage as a key Assistance tier and, like, data layer for Chroma distributed in Chroma Cloud as well.”
Assertion Not checkable as stated
Huber: Chroma is currently serving hundreds of thousands of developers
“And obviously I'm incredibly proud that it exists today and that it's like serving hundreds of thousands of developers and they love it, but it was hard to get there.”