Kiela: Enterprise AI Demands End-to-End Retrieval Models Over Parametric Monoliths
Douwe Kiela · How Enterprise Companies are Buying AI (or Not) with ContextualAI, Anthropic, and Glean · Jan 17, 2024 · at 20:14
Douwe Kiela, CEO of Contextual AI, argues that standard large language models cannot meet enterprise standards without native, end-to-end retrieval architectures.
0:00 / 0:27exact quote · 27.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And so we think that's not what we now call a language model. So it's not one big parametric monster. It's something a bit more elegant that has the retrieval kind of built in. It's a retrieval augmented language model and is strained end to end so that it can rely on information that's external. And so that means that it will hallucinate less. It will have attribution. It will stay up to date. It will not have compliance issues. You will have a very clean separation between the data and the model plane.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Douwe Kiela
Kiela: Companies Will Stop Trying to Build In-House AI Within Years
“Very often they think they can do it in house.
And so I think that belief is probably going to go away in the next couple of years where people realize that this stuff is a little bit more difficult than they,
Initially thought.”
Kiela: Top-Down Enterprise AI Budgets Will Dry Up After Failed Pilots
“That money is temporary and it's going to dry up. And so it's, we're going to have a couple of cool pilots and demos, and then at some point it doesn't work and we will move on to the next hype train.”
Kiela: Enterprises do not need model fine-tuning when RAG is available
“You don't have to fine tune your model. It feels very intuitive. We have this great data set. We own it. It's our data. So we need to do something useful with it. So we need to fine tune our own language model. And so the companies who are offering that servic…”
Kiela: First-Generation LLMs Are Not Ready for Enterprise Deployment
“We think language models are great first generation technology, but they're not quite ready. We see a lot of frustration in the market around that.”
Kiela: 95% of Enterprise AI Use Cases Fall into Three Buckets
“I think if you look at the landscape of use cases that we see right now, there are roughly three big buckets. So one is around information discovery and information synthesis... Then there's a lot of hierarchical summarization use cases... And then there's a l…”
Kiela: By 2030, Workers Will Manage Fleets of AI Co-Pilots
“What I think is going to happen is that there's a couple of CEOs on the stage here, and I'm sure there's a couple of CEOs in the audience, so we will all be our own CEO of our little company of AI co-pilots that are going to be doing a lot of very boring, mund…”