Shopify transitioned its ETL platform from Ruby to Python around 2013-2014
Solmaz Shahalizadeh · Fireside Chat: Solmaz Shahalizadeh, VP of Data Science & Engineering at Shopify (Data Driven NYC) · Jun 12, 2019 · at 9:09
Solmaz Shahalizadeh, VP of Data Science & Engineering at Shopify, details the early technology choices behind Shopify's data infrastructure evolution.
0:00 / 0:17exact quote · 17.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Shopify, the application is still Ruby on Rails, and actually the first version of ETL tooling that was built in house was Ruby, but I think we made this decision of moving to Python around 20 13, 20 14, because we thought it's the language that most of the community and people we want to hire are using”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Solmaz Shahalizadeh
Causal inference will solve key data problems ignored by machine learning hype
“There's a lot of hype and focus and good work in machine learning. But I do think if we take a step back and look at causal inference, we're gonna actually solve a lot of problems with just that arm. So I hope over the next few years, like, people invest in th…”
Shahalizadeh: Moving from rules to machine learning yields highest lift
“The first time you go from any rule base or non-machine learning to machine learning actually is the time that you get the highest lift.”
Shahalizadeh hires machine learning talent by looking outside traditional ML backgrounds
“I recruit machine learning people by not going after machine learning people.”
Shahalizadeh: Answering simple questions drives more data impact than machine learning
“And I think that's sort of a neglected part of data science. Everyone talks about, like machine learning and building all of these data products, but I think lots of the impact, lots of the trust and usage of data actually comes from being able to answer to so…”