Modern Data Stack
topic on 3 shows · 19 statements across 11 episodes
We Live to Build
Latent Space
the MAD Podcast
19 statements about Modern Data Stack, every show
Gupta: Enterprises use only 15% of their data tools' capabilities
“What you will realize is these 10 to 15 tools that every enterprise is paying for, actually they are not using more than 15 to 20% of their tools capability.”
Xin: Customer friction with vendor sprawl forced Modern Data Stack consolidation
“What people eventually run into, It's kind of a question of a unification and consolidation is, hey, do you really need to chop all of this into different pieces and work with so many different vendors and platforms in order to get like a very simple visualiza…”
Xin: AI agent tooling is consolidating like Modern Data Stack did
“I think honestly something like this is probably happening in how many different frameworks do you want to hook up together in order to produce, like do a very simple agent?”
Garg: Context graph stack will eclipse modern data stack value by 10x
“Two, I think the enabling infrastructure stack for context graphs would be well-defined. And there will be variations and flavors, but, you know, I totally anticipate that this time next year we'll be writing, okay, here's, here's the way, here's the best prac…”
Handy: Venture capital created too many data startups too quickly
“There was just, there were too many companies created too quickly.”
dbt CEO Tristan Handy: The modern data stack concept is dead
“I don't think the modern data stack is a useful idea anymore.”
Handy asked dbt marketing to adopt 'the analytics stack' label
“My big conclusion is I sent an email to our product marketing, our head of product marketing. I was like, Hey, can we just say the analytics stack? Like this is a set of technologies that works together to do analytics. And it kind of tries to get away from th…”
Tristan Handy: Software multiple expansion has shifted from modern data stack to AI
“If what you were trying to do is maximize the multiple that your software company was trading at, then AI is the enemy because all the multiple expansion has moved from modern data stack to AI.”
Keydunov: Modern data stack will not be dramatically disrupted by AI
“I don't see a lot of being compacted by AI specifically. I think, you know, that space is being compacted as much as any other space in terms of, yes, we'll have all this copilot capabilities, some of AI capabilities here and there, but I don't see anything so…”
Keydunov: The modern data stack will enter a consolidation cycle
“I feel like right now we should go through the cycle of consolidation. And you know, like I mean, if Fivetrend and dbt merge, they can be alter-ex of a new generation or something like that. And you know, probably some ETL tool to there. But I feel it might ha…”
Catanzaro expects current modern data stack tools to be replaced
“I expect the same to happen with regards to the modern data stack.”
Turck: Fully managed data platforms emerge to simplify multi-vendor stacks
“This emergence of fully managed data platforms that quite often abstract away a lot of those vendors. Into just one interface. So you deal with one vendor, one contract, and you don't have to worry about the stitching.”
Turck: Cost pressures accelerate architectures using S3, Iceberg, and DuckDB
“And then there's the acceleration of like alternative architectures, you know, storage. Why don't you just dump everything in S three, which is very cheap. And then, you know, you could use iceberg on top to add some structure to it. You can, we talked about D…”
The modern data stack is fragmented and ill-suited for real-time data
“The modern data stack is incredibly fragmented and is not well suited for real time Use cases when you want to work with fresh data and you want to do it at scale.”
Stancil: Modern data stack startups face an inevitable market reckoning
“Pretty quickly you're gonna realize they're all stepping on each other's toes, and that, that fallout has to go somewhere. Like, not all of these companies can be the next Figma that they all now say that they are, and so it's what happens then, and I think it…”
Benn Stancil: Analytics tools will eventually embed directly inside workflow software
“You could potentially incorporate data into that, such that the data sort of surfaced to people in the moment they need it in the product you're trying to use to solve the problem, instead of going to a dashboard and, like, clicking on some stuff. So I think t…”
Handy: The original modern data stack was four core layers
“The original modern data stack was four layers. It was data ingestion. How do you get your data from all of your different upstream systems? It was data storage or warehousing, and how do you actually store and compute data? It was transformation. And then it …”
Handy: Gap between modern data stack and machine learning will vanish by 2027
“Again, if you look in five years, I think that this distinction will have been sanded over and will not be salient anymore.”
Handy defines the modern data stack across four distinct functional layers
“When we talk about the modern data stack, we think about what's really four layers. So there's data ingestion. There's the data warehouse. There's data transformation or like taking all that raw data and like turning it into something valuable. And then there'…”