Housley: Moving from Hadoop to cloud data stacks has been very tough
Matt Housley · Fundamentals of Data Engineering | Joe Reis and Matt Housley · Oct 24, 2022 · at 1:03
Matt Housley, co-author of Fundamentals of Data Engineering and co-founder of Ternary Data, speaks at Data Driven NYC about the industry shift from legacy big data tooling to modern cloud infrastructure.
0:00 / 0:20exact quote · 20.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“One of the things, one of the transitions that Joe and I went through, which I think a lot of people in this room went through, was the transition from the Hadoop world, from the previous big data world, into this new, like, cloud-based data engineering snack, and that has been a very tough transition, and it's also been hard for people coming into the field to find information about how to train as data engineers.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Matt Housley
Housley: Core data engineering issues haven't changed in 20 years
“A lot of the core issues in data engineering actually haven't changed that much in 20 years, and so people got so excited about technology in the transition in the 2000, the internet bubble, rise of Google, the rise of Facebook, that they lost sight of that”