Enterprise AI Systems
topic on 3 shows · 3 statements across 3 episodes
Latent Space 
the Neon Show 
20VC
3 statements about Enterprise AI Systems, every show
Biderman: Manually partitioning LLM memory vs retrieval becomes unmanageable whack-a-mole
“And now the thing is, if you start manually, heuristically saying this is in, this is out, then it becomes a whack-a-mole. Every, every person in every enterprise has different data, and you can really very easily pick and choose what goes in and what goes out…”
Ameya Bhatawdekar: Enterprise AI quality comes from surrounding engineering, not just models
“These intelligent systems, these AI systems are not just a model, right? There's a lot of layering that happens on top of these models. These systems have to really deliver specific capabilities or specific experiences that help people do certain specific task…”
Sivulka: 90% of enterprise AI queries require computation beyond RAG search
“And so all of these questions, it was actually almost 90% of the questions that people were asking these systems weren't answerable by search through the documents. But rather they had to be work done on top of the documents and then answered.”