why aren't all 12 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Opinion
Liberty: OSS Vector Database Competitors Are Already Struggling With Commercialization
“And in fact, we already see, even though new players in the vector database space that, that, that basically started to try to take us down, all took the open source angle. We already see them, even young as they might be, they are already struggling, struggli…”
Assertion Not checkable as stated
Liberty: Context Window Stuffing Increases LLM Costs Without Improving Results
“There's plenty of evidence that increasing the context size doesn't actually improve results unless, you know, you do this very carefully, right? So just what's called constant stuffing is not helping. You just pay more and don't actually get much for it.”
Insight
Liberty: Proper embedding retrieval rarely requires keywords alongside embeddings
“Our research actually shows that when you do this well, we, you very rarely need keywords alongside embeddings, but getting embeddings to perform perfectly is, is actually, it could be quite intricate.”
Assertion Partly supported
Liberty: RAG Over Internet Data Reduces LLM Hallucinations by 50%
“And you could see that if you augment all of them with RAG on, even on the internet, which is data that they were trained on, you can reduce hallucinations significantly up to 50% sometimes.”
Assertion Partly supported
Liberty: High 90s Percentage of OSS Code Comes From Vendor Employees
“And in fact, if you look at statistics, even companies that are open source, 99% of the contributions are actually from the company itself. Not 99, but high nineties.”
Opinion
Liberty: Retrofitted Vector Indexes Like pgvector Fail at Production Scale
“Those other products don't work. They don't work either because they don't scale in terms of the efficiency scale, cost, the trade-offs that they can offer, because they're not designed to do this. They're designed to do something else. They kind of thought ab…”
Assertion Supported
Liberty: Notion Q&A runs AI question answering on Pinecone
“Notion Q&A now runs on, on Pinecone, and they serve essentially question answering with AI to tens of thousands and probably hundreds of thousands of their own customers.”
Disclosure
Liberty: RAG Architectures Pair Small Models With Trillion-Parameter Vector Databases
“Already today, we have users who use not even very large models, you know, maybe a few billion parameters, and the vector database next to the model contains trillions of parameters. And they get, you know, much better performance that way.”
Assertion Supported
Liberty: Gong uses Pinecone for all customer sales call search
“Gong does the same thing with sales calls. Again, serves all of their use cases for all of their customers, and so on.”
Assertion Not checkable as stated
Liberty: Pinecone Serverless is the fourth near-complete rewrite of its database
“Serverless is the fourth complete, almost complete rewrite of the entire database at Pinecon.”
Assertion Not checkable as stated
Liberty: Pinecone Serverless Tested with Tens of Billions of Vectors
“We've tested it with tens and tens of billions with live customers and live traffic.”
Assertion Not checkable as stated
Liberty: Mainstream Engineers Were Already Adopting BERT by 2019
“In 2019, the earthquake had already happened. Deep learning models and so on have already been grappled with. Large language models and transformer models like BERT and others started being used by the more mainstream engineering cohorts.”