Bloom: 95% of production machine learning code is just glue code
Josh Bloom · Machine Learning in Production with Josh Bloom, Co-founder Wise.io · Nov 23, 2015 · at 11:55
Josh Bloom, co-founder and CTO of Wise.io, references Google's paper on technical debt in machine learning during a 2015 presentation at Data Driven NYC.
0:00 / 0:09exact quote · 9.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Algorithms are important, but 95% of all machine learning code in production is actually just glue code. It's connecting all of these different pieces together.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Josh Bloom
Bloom: Very few data science teams prioritize model explainability
“Explainability or interpretability turned out to be a very, very important optimization that very few data science teams will be cognizant of unless they're really thinking about it.”
Bloom: Netflix couldn't deploy its $1M prize algorithm due to complexity
“They paid a million dollar bounty, and they wound up looking at the code, and there were hundreds of separate models that were then boosted together, and they said there's no way we can do it.”
Wise.io's ML automatically resolves 5% to 20% of support tickets
“Over time, the system becomes so confident in some fraction of the answers, Five to 10 to 20%. It can basically just answer them without any humans on our client side actually looking at it, and those tickets get solved and people are satisfied.”
Wise.io chose managed cloud services over building infrastructure in-house
“So we made, as a young startup, the decision that if there was a managed service around what we needed to do to get something into production, and we're at the millions of predictions level a month over dozens of customers now, we were just going to, we were j…”
Bloom: ML platform decisions must center on production and maintenance costs
“The other ones that I think are critical when making those decisions about which platforms to use and implement within your own organizations is, what is that cost and time to actually put this into production? And then once you put it into production, what is…”