AI startups prioritize rapid shipping over accuracy and factfulness
Milos Rusic · From NLP Start-Up to Generative-AI Platform: Milos Rusic (deepset) Unpacks Product-Market Fit · Sep 6, 2023 · at 29:17
Milos Rusic is CEO and co-founder of Deepset. He contrasts the needs and priorities of early-stage startups with risk-averse enterprise clients like banks when building LLM applications.
0:00 / 0:12exact quote · 12.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“If you care so much around about the factfulness of your applications, you're probably not a startup, right? Startups, you know, you want to ship fast. You do whatever works best. You assemble something, it's shipped.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Milos Rusic
The only meaningful way to adopt NLP and LLMs is cloud-based
“The only meaningful way to adopt to adopt NLP and LLMs is in the cloud”
Europe's conservative enterprise tech adoption limits local startup growth ceilings
“Europe is that simply, you know, a bit more conservative in the way they adopt new technologies, right? And this is this is usually then a bit harder for these companies to, you know, to grow in their home markets, right?”
RAG systems need dedicated hallucination detectors to verify LLM outputs
“If you want to make sure that there's not a, that the model doesn't hallucinate, you probably want a hallucination detector on top, right? Something that classifies an answer and confirms, is this answer really part of my database?”
Model transparency and research drive enterprise AI adoption
“More transparency we can create also around, you know, how models have been trained, You know, the more research we have around the model, of course, the more trust it creates and easier it is for companies to adopt.”
Maturing database products differentiate, making integrations harder to maintain
“All these products are maturing and also differentiating, right? So it is becoming more and more of an effort, to be honest, to really manage this.”
Consumption is the best metric to reflect LLM system value
“Is probably the best metric to somehow reflect the value that comes out of these LLM systems, right? Because in the end, the more requests a model gets, or application gets, probably the more valuable it is. The more data you load into it, probably the more va…”