Data Ingestion
topic on 2 shows · 2 statements across 2 episodes
2 statements about Data Ingestion, every show
Huber: Pre-Baking Metadata and Chunk Rewriting at Ingestion Simplifies Retrieval
“As much structured information as you can put into your write or your ingestion pipeline, you should. So all of the metadata you can extract, do it at ingestion. All of the chunk rewriting you can do, do it at ingestion. If you really invest in, like, trying t…”
Handy defines the modern data stack across four distinct functional layers
“When we talk about the modern data stack, we think about what's really four layers. So there's data ingestion. There's the data warehouse. There's data transformation or like taking all that raw data and like turning it into something valuable. And then there'…”