Cloud data warehouses enabled modern multi-tool data architectures
Viraj Parekh · Modern Data Orchestration | Astronomer Co-Founders Pete DeJoy & Viraj Parekh · Oct 10, 2022 · at 2:20
Viraj Parekh, co-founder of Astronomer, speaks at Data Driven NYC about how modern data architecture and orchestration evolved alongside platforms like Snowflake and Databricks.
0:00 / 0:18exact quote · 18.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Architectures like this really have only become possible with the rise of folks like Snowflake, Databricks, Redshift, BigQuery, and this idea that as a data practitioner, I can have infinite compute at the kind of tips of my fingers without having to go outside of the data warehouse.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Viraj Parekh
Bypassing Git simplifies source control for non-software data teams
“The fact that I can take my skill set and have a source controlled pipeline without actually having to learn Git makes all the downstream people on my team's lives so much easier because they know exactly what I did and what I changed and they still get that r…”
Seeing manipulated data directly increases data engineer productivity
“I just think that as a data engineer, if you have to actually go ahead and maintain a pipeline, being able to see the actual data manipulated really increases your productivity.”
Data scientists do the 'sexiest work' on data teams
“And lastly, you know, your data scientists who, in my opinion, are kind of doing the sexiest work when making business predictions based off of data, their needs are also different.”