Liu: LLM data pipelines differ from traditional ETL stacks due to unstructured content comprehension
Jerry Liu · Building LlamaIndex: Jerry Liu on Scaling Retrieval-Augmented AI · Jul 12, 2023 · at 18:57
Jerry Liu is the co-founder and CEO of LlamaIndex. He explains why data ingestion and extraction for large language models require a new paradigm compared to classic data warehousing.
0:00 / 0:22exact quote · 23.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“If we're building this new age of L-empowered applications, The kind of requirements for the type of data that like you want to load as well as how you want to extract information from that data will be a little bit different than the existing ETL stack. The reason is LLMs have this inherent capability of like just understanding unstructured information along with structured information.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Jerry Liu
LlamaIndex is not building a vector database, integrates with 12-20 existing ones
“We're not building our own vector database, but we have a rich set of integrations with, you know like 12 to like 20 different vector databases out there these days.”
LlamaIndex focuses on data infrastructure while LangChain builds broader application frameworks
“Blind train is a great application framework for you to just like get us out of building blocks for a lot of different components, for instance, from like LL modules to prompts to some basic like retrieval and vector database abstractions to like also agent fr…”
Liu: Uber and Instabase use LlamaIndex for enterprise data applications
“We've seen people build these workflows at different settings from, for instance, like hacks on projects at startups building, for instance, like track GPT, like, plugin over, like, your Slack or your Notion all the way to kind of, like, bigger companies, for …”
Liu: Generating long-form content over custom data remains a hard problem
“Generating something that's like a paragraph is pretty easy for ChatGPT to do. Generating like an entire blog post or essay, especially over your data is a pretty challenging problem.”
Jerry Liu: Injecting metadata into text chunks improves LLM retrieval performance
“Second is being able to inject metadata actually is quite important to actually improve retrieval performance of like the downstream application, because like, you know, let's say you're splitting up like a sec, 10 K filing into a bunch of chunks within a sing…”