“A lot of the core issues in data engineering actually haven't changed that much in 20 years, and so people got so excited about technology in the transition in the 2000, the internet bubble, rise of Google, the rise of Facebook, that they lost sight of that”
quote is from the automated transcript, cleaned for reading:
filler sounds and stutters are removed, nothing is rephrased. names can be misheard
(the analysis reads context, assessments check outside sources). how →
More from Matt Housley
AssertionNot checkable as stated
Housley: Moving from Hadoop to cloud data stacks has been very tough
“One of the things, one of the transitions that Joe and I went through, which I think a lot of people in this room went through, was the transition from the Hadoop world, from the previous big data world, into this new, like, cloud-based data engineering snack,…”
Matt HousleyOct 24, 2022▶ 1:03Fundamentals of Data Engineering | Joe Reis and Matt Housley
Insight
Housley: Many big data era data lakes turned into data swamps
“In many cases, I mean, I, I've worked in companies like this, it just turned into a data swamp, and that's because, in spite of the amazing technology we had, we kind of lost sight of these fundamental things.”
Matt HousleyOct 24, 2022▶ 6:55Fundamentals of Data Engineering | Joe Reis and Matt Housley
Insight
Housley: Statistics and ML skills cannot overcome poor data inputs
“No matter how good you are at statistics or machine learning, it's hard to make sense of data without having some quality inputs.”
Matt HousleyOct 24, 2022▶ 12:07Fundamentals of Data Engineering | Joe Reis and Matt Housley
Made with StarZero
Turn any episode into a week of clips.
This entire site, over 400 conversations transcribed, diarized, checked and made playable,
runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the
moments worth sharing, cuts them, captions them, and reframes them for every feed.
We use essential cookies to make the site work. With your permission we
also use analytics cookies (Google Analytics and Mixpanel) to understand
usage and improve StarZero. See our Cookie Policy.