Deepset's core LLM tech stack will always remain open source
Milos Rusic · From NLP Start-Up to Generative-AI Platform: Milos Rusic (deepset) Unpacks Product-Market Fit · Sep 6, 2023 · at 29:50
Milos Rusic is the co-founder and CEO of Deepset, creator of the open-source Haystack framework and Deepset Cloud platform. He describes how Deepset differentiates open-source features from paid cloud offerings.
0:00 / 0:07exact quote · 7.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Everything that you need to really have an LL application, like technically the full tech stack, that will always be open source.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Milos Rusic
The only meaningful way to adopt NLP and LLMs is cloud-based
“The only meaningful way to adopt to adopt NLP and LLMs is in the cloud”
AI startups prioritize rapid shipping over accuracy and factfulness
“If you care so much around about the factfulness of your applications, you're probably not a startup, right? Startups, you know, you want to ship fast. You do whatever works best. You assemble something, it's shipped.”
Europe's conservative enterprise tech adoption limits local startup growth ceilings
“Europe is that simply, you know, a bit more conservative in the way they adopt new technologies, right? And this is this is usually then a bit harder for these companies to, you know, to grow in their home markets, right?”
RAG systems need dedicated hallucination detectors to verify LLM outputs
“If you want to make sure that there's not a, that the model doesn't hallucinate, you probably want a hallucination detector on top, right? Something that classifies an answer and confirms, is this answer really part of my database?”