Oppenheimer: Serverless AI architecture can cut infrastructure costs by up to 85%
Diego Oppenheimer · Building an Operating System for AI // Diego Oppenheimer, Algorithmia (FirstMark's Data Driven) · Mar 2, 2018 · at 10:33
Diego Oppenheimer, founder and CEO of Algorithmia, presents at DataDrivenNYC on the financial and operational efficiency of serverless machine learning inference.
0:00 / 0:18exact quote · 18.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Using serverless, we can actually track as the demand comes in. We can use our load balancers to quickly initiate and replicate these models over the entire infrastructure, going up and down with the demand, allowing for savings of up to 85% of the infrastructure cost that I'm actually going to be deploying in this case.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Diego Oppenheimer
Oppenheimer: ML inference belongs to DevOps, not data scientists
“We think that the inference side of things is actually owned by DevOps and the infrastructure teams”
Oppenheimer: TensorFlow is open source, but scaling it is not
“TensorFlow is open source, but actually scaling it is not.”
Oppenheimer: AI and machine learning are the killer apps for serverless
“I actually think that AI and machine learning are the killer apps for serverless microservices.”
Oppenheimer: Data is heavy and expensive to move, but compute is light and cheap
“So there's a design principle that we use, personally, at Algorithmia, which is data is heavy and expensive to move, but compute is light and cheap.”