Enterprise AI adoption fails without risk mitigation despite performance gains
Adam Wenchel · Production AI: Lessons Learned the Hard Way // Adam Wenchel, Arthur.ai (FirstMark's Data Driven NYC) · Jan 22, 2020 · at 9:00
Adam Wenchel, CEO of Arthur.ai, discusses organizational barriers to adopting AI models in large enterprises during a talk at Data Driven NYC.
0:00 / 0:27exact quote · 27.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Especially large traditional enterprises there tend to be very consensus-driven cultures by nature, and so the, even if people, if a data scientist can demonstrate they have a model that, you know, generally, like, gets some huge five or 10% lift, which, you know, again, it could be hundreds of millions of dollars, an upside for the business, if there's a sort of risk of the unknown, right, with putting a new model in there, and if you don't have a way to mitigate that It's really hard to kind of get internal stakeholders to sign off on the adoption of that.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Adam Wenchel
Most companies using AI suffer from unpublicized model failures
“Every company that's doing anything substantive with AI probably suffers from any of these problems, it's just a few of them have actually, ah, made the headlines for it”
Open-source explainable AI tools like LIME and SHAP fail enterprise scale
“If you look at the open source components they're not very scalable. They're not easy to deploy at scale. They're really, they're useful, like, if you're a data scientist, and you have your Jupyter notebook, and you're, you know, running an experiment locally,…”
Real-world AI deployments introduce distinct failure modes beyond lab environments
“And it's not only hard to develop in the lab, but once you develop it and put it in the real world, there's a whole new set of categories of ways it can go wrong.”
Historical anti-bias regulations apply directly to AI models
“There's a lot of historical regulation around anti-discrimination and bias and things like that that, ah, certainly applies just as much to AI models as it does to humans and more simple analytical models.”
Lack of trust delays enterprise AI deployments for months
“We, you know, encounter this all the time, where in organizations, they have these big plans for AI but they're just, They're unsure about actually deploying them and turning them on, and things get held up for months and months and months because of that.”