Data operations require specialized software engineering rigor and tools
Nick Schrock · Fireside Chat: Nick Schrock (Founder & CEO, Elementl) with Matt Turck (Partner, FirstMark) · Jun 21, 2021 · at 2:54
Nick Schrock, Founder and CEO of Elementl, discusses the evolution of data infrastructure and developer tooling during a 2021 Data Driven NYC fireside chat with FirstMark Partner Matt Turck.
0:00 / 0:18exact quote · 18.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“What really needs to happen in this data space is the software kind of engineering of vacation of data. The acknowledgement that this is not an off outsourceable thing anymore, that this requires software engineering process specialized for the data domain and the tools and abstractions that, that match that.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Nick Schrock
Data orchestrators are the central leverage point for organizational data platforms
“We think this like orchestrator is really the central leverage point that makes sense to be the data platform.”
Data orchestrators must be productive developer environments, not just operational tools
“It's critical not to just think of it as a operational tool, but as a place where people can productively work.”
Data teams should focus on computation processes rather than physical datasets
“People think of data sets as physical things, right? Like a table and a database. Right. But in the modern world where you're really applying software engineering processes to data, all that data ends up being computed. And so what we thought really is that yo…”
Data tools should upskill analysts with engineering processes, not replace them
“The way to do this is not to try to remove analysts from the equation. The way to do this is to bring engineering processes into their life and, you know, so-called upskill them.”
Data challenges have shifted from compute scale to developer productivity
“An amazing engineering achievement happened in the early, you know, throughout the 2010, which was solving these massive pure technical scale problems. But now we're talking about organizational scale, dealing with complexity and dealing with developer product…”