Everything Adam Wenchel said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Most companies using AI suffer from unpublicized model failures
“Every company that's doing anything substantive with AI probably suffers from any of these problems, it's just a few of them have actually, ah, made the headlines for it”
Open-source explainable AI tools like LIME and SHAP fail enterprise scale
“If you look at the open source components they're not very scalable. They're not easy to deploy at scale. They're really, they're useful, like, if you're a data scientist, and you have your Jupyter notebook, and you're, you know, running an experiment locally,…”
Real-world AI deployments introduce distinct failure modes beyond lab environments
“And it's not only hard to develop in the lab, but once you develop it and put it in the real world, there's a whole new set of categories of ways it can go wrong.”
Historical anti-bias regulations apply directly to AI models
“There's a lot of historical regulation around anti-discrimination and bias and things like that that, ah, certainly applies just as much to AI models as it does to humans and more simple analytical models.”
Lack of trust delays enterprise AI deployments for months
“We, you know, encounter this all the time, where in organizations, they have these big plans for AI but they're just, They're unsure about actually deploying them and turning them on, and things get held up for months and months and months because of that.”
Deployed AI models suffer immediate performance gaps and ongoing degradation
“The second you put it in the real world, models, ah, number one, there's a gap right from day one, and they get worse over time.”
Not collecting protected class data does not prevent algorithmic bias
“What's happened a lot in the past is people have kind of like taken the head in the sand approach where they've sort of said like, oh you know, we're not even collecting protected classes, so we can't possibly be biased as far as we know, and that's no longer …”
A fractional drop in AI performance can cost hundreds of millions
“Even if your model encounters some sort of issue that drops at a couple 10th of a percent in performance, that can literally be hundreds of millions of dollars over time, and so the ROI on having that kind of monitoring in place is, is huge.”
Enterprise AI adoption fails without risk mitigation despite performance gains
“Especially large traditional enterprises there tend to be very consensus-driven cultures by nature, and so the, even if people, if a data scientist can demonstrate they have a model that, you know, generally, like, gets some huge five or 10% lift, which, you k…”
Visual AI explainability helps build trust in skeptical academic communities
“Ah, and then the other thing is, you can imagine this world of humanities research has not changed a whole lot in the, like, the last 200 years of study, and so bringing this sort of innovation, like, we can automate this and computers can find patterns that w…”
Early safety guardrails enable companies to pursue more aggressive AI strategies
“Like the more you can build these guardrails in from kind of day one of your AI projects, when you, it allows you to be more aggressive, right? Just like the safety systems on an F-one car allow you to lap faster. If you build this stuff in from the beginning …”
Credit underwriting AI feedback loops take three to four years
“There's other ones like, ah, underwriting credit cards, where you might not know for three or four years whether you should have given that person a credit card, right?”