Liberty: Cloud hyperscalers are actively building competing vector database capabilities
Edo Liberty · Long Term Memory for AI with Pinecone Founder & CEO, Edo Liberty · May 31, 2023 · at 27:08
Edo Liberty, founder and CEO of Pinecone and former AWS lead, addresses how major cloud providers view the vector database market.
0:00 / 0:04exact quote · 4.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I know for a fact they're looking at it. I know for a fact they will have something.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Edo Liberty
Liberty: Prompt engineering is a fad, not a long-term profession
“A lot of people believe that prompt engineering is incredibly crucial. I don't necessarily buy into that. I don't know if you remember, but people, like, thought that, like you know query building for Google would be a profession too, right? And that didn't qu…”
Liberty: AI architecture is shifting toward external memory during inference
“I think there is a significant shift in the way that people think about these building these smart AI systems. And They don't try to fit the data into the model as much as give the model access to the right data when it's doing the inference, right?”
Edo Liberty: Vector databases serve as long-term memory for AI
“A vector database is the infrastructure that, that supports that long-term memory, right?”
Liberty: Keyword search dominated due to scaling efficiency, not search quality
“Traditional search is, is, is keyword based. Not because keyword search is that great, but just because we have great mechanism to run it at scale, and it's very efficient.”
Edo Liberty: Semantic search mirrors human memory better than keyword lookup
“With semantic search, the whole idea is that You know what it means. You can, you should be able to search by the meaning in free text, and the match would not be because, oh, like three words matched, and they're next to each other, but rather the meaning is …”