Hwang: Machine learning models frequently maximize objectives in unexpected ways
Tim Hwang · At the Intersection of AI, Governments, and Google - Tim Hwang · Y Combinator · Jun 16, 2017 · at 4:09
Tim Hwang, Google's Global Public Policy Lead on AI, discusses common pitfalls and failure points early-stage startups encounter when training machine learning models on large datasets.
0:00 / 0:15exact quote · 15.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“One of the most common problems is just that you don't adequately think through your data, and so the machine does what the machine does, right, which is trying to optimize against your objective function that you give it. And it'll often maximize in ways that you don't expect, and that is, in fact, part of the problem, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Tim Hwang
Hwang: AutoML could eliminate the need for machine learning specialists
“This emerging research right now, which is using machine learning to train machine learning systems, raises, like, this meta level, where, like, right now there's a lot of handwork that goes into building a model so it learns the right representations, but, li…”
Hwang: Open publishing should be the default standard in AI research
“I'm very pro open publishing. Like, I think, like, it should be the default, and it's like, I'm still disputing situations where I'm like, you shouldn't publish on this stuff. Just because like, I think it is actually to the benefit of everybody to know what t…”
Hwang: The assumption that all automatable tasks will be automated is false
“Everybody always assumes that like, okay, if it can be automated, it definitely will be automated, right? But that's like a fallacy, because in certain cases, like, you may really worry about the security of your systems, right?”
Hwang: GDPR introduces a potential right to explanation for automated decisions
“So, one of the most interesting aspects of the GDPR, which is a new privacy regulation in Europe, is the potential for this, what they call kind of a right to explanation. So the idea is, for certain kinds of automated decision making, it might be so significa…”
Hwang: The AI competitive moat is shifting from data to interface design
“The amount of data you need to pull off certain types of machine learning applications is going down over time. And what that tells me is that there might not be necessarily a first-mover advantage in this space, where you may actually have collected a bunch o…”
Hwang: The public sees non-ML robots as AI, ignoring newsfeeds
“The newsfeed assuredly is AI, right? Like, it uses machine learning. It uses the latest machine learning to do what it does. We don't really think about it as AI, right? Whereas, like, the car is, like I mean, I think a lot of robots kind of fall into this cat…”