Infrastructure, not algorithms, is the primary barrier to AI adoption
Dillon Erb · CI/CD for Machine Learning & AI // Dillon Erb, Paperspace (FirstMark's Data Driven NYC) · Feb 25, 2019 · at 4:57
Dillon Erb, founder and CEO of Paperspace, discusses machine learning infrastructure challenges during a presentation at Data Driven NYC in 2019.
0:00 / 0:05exact quote · 5.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I'm gonna make the case that the biggest barrier to adoption is an infrastructure and tooling problem, not necessarily an algorithmic problem.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dillon Erb
Erb: Existing CI/CD workflows do not fit machine learning pipelines
“Existing CI CD workflows, talking about how those don't really fit anymore. And then making the case that you know, these new pipelines are fundamentally different and require new tools, new workflows, and generally like new paradigms.”
Erb: Billions have been invested in pre-product AI hardware unicorns
“A few billion dollars have been invested in new hardware startups. There are a few unicorns already for companies that don't have products fully out yet.”
Erb: AI researchers and infrastructure teams view algorithmic primitives completely differently
“So if you're an AI or machine learning or deep learning developer or researcher, you think of your primitives as, you know, hidden layers and LSTMs and things like that. From an infrastructure perspective, it's actually much higher up”
Tech giants like Google and Uber rely on home-rolled ML infrastructure
“Most of the tooling is kind of home rolled. Best practices haven't emerged yet. We're seeing a lot of, especially large companies, roll their entire own stacks. So Facebook has FB Learner, Google has TFX. Uber has Michelangelo. Airbnb has Big Head.”
CI/CD principles address the black-box interpretability problem in deep learning
“You care about it because it adds reliability, reproducibility, determinism. You know, your systems are no longer inscrutable, which is a very big criticism, especially of deep learning architectures, which is that they're black box or they're, you know, they …”