Liberty: Operating vector databases at 100x scale requires blob storage over SSDs
Edo Liberty · He got rejected by 40 VCs & had 6 months of runway—2 years later, he raised $100M from a16z. | Ed... · PMF Show · Mar 17, 2025 · at 50:22
Pinecone founder and CEO Edo Liberty discusses architectural realizations about vector database infrastructure at massive production scale.
0:00 / 0:30exact quote · 30.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“If we need to do this at what, if we need to do this at the, you know, hundred X scale of where we are today, we're going to have to build something very, very, very different. Separate, separates writes and reads, that multi, that has multi-tenancy sort of built in, that the storage is all Blob. You cannot afford to use SSDs anymore because it becomes too expensive. You have to be, there's so many core tenets that you had to change in the system for it to be able to work at those sizes.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Edo Liberty
Liberty: Founders Should Not Factor Financials Into Defining a Good Outcome
“When you're a startup founder, you really have to think about what's important to you, what you're willing to tolerate, what is a good outcome in your opinion. My suggestion is to not factor in financials into what a good outcome looks like.”
Liberty: Serverless reduced Pinecone customer costs from $4,000 to $200
“So now we're, we could run, we can offer the service to be 10 X cheaper. So the cost, so people who used to pay us, you know, three, 4000 dollars a month started paying 200 bucks a month.”
Liberty: AI Agents Will Know All Internal Company Data Within Five Years
“I'm telling you in five years, the thought that maybe the conversational agent that you are talking to inside your company hasn't Listen to all the sales calls that ever, ever happened. The company knows everything about your product and can talk about it inte…”
Liberty: Staying at AWS Would Have Paid More Than Founding Pinecone
“Even now to this day, we're five years in. Pinecone is a raving success and so on. I have, I would have done much to this day. I mean, put my stock aside, I will have done a lot better had I stayed at AWS, right?”
Liberty: The term 'vector database' did not exist when Pinecone started
“The term vector database didn't exist. It just didn't exist. We'd, nobody talked about it this way.”
Liberty: 70% of Early Users Already Called Pinecone a Vector Database
“We literally asked them like, Hey, you internally in your team, you talk about using this pine cone thing. What do you think it is? What do you call this internally? Seven out of 10 would say, we just call it a vector database. It's like, that's where it's, we…”