Bypassing Git simplifies source control for non-software data teams
Viraj Parekh · Modern Data Orchestration | Astronomer Co-Founders Pete DeJoy & Viraj Parekh · Oct 10, 2022 · at 15:18
Viraj Parekh, co-founder of Astronomer, discusses how Astro allows non-software engineers to manage pipeline code without learning complex Git commands.
0:00 / 0:15exact quote · 15.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The fact that I can take my skill set and have a source controlled pipeline without actually having to learn Git makes all the downstream people on my team's lives so much easier because they know exactly what I did and what I changed and they still get that reproducibility without me even knowing I'm giving it to them.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Viraj Parekh
Cloud data warehouses enabled modern multi-tool data architectures
“Architectures like this really have only become possible with the rise of folks like Snowflake, Databricks, Redshift, BigQuery, and this idea that as a data practitioner, I can have infinite compute at the kind of tips of my fingers without having to go outsid…”
Seeing manipulated data directly increases data engineer productivity
“I just think that as a data engineer, if you have to actually go ahead and maintain a pipeline, being able to see the actual data manipulated really increases your productivity.”
Data scientists do the 'sexiest work' on data teams
“And lastly, you know, your data scientists who, in my opinion, are kind of doing the sexiest work when making business predictions based off of data, their needs are also different.”