Hwang: De-biasing AI models creates trade-offs with minority data privacy
Tim Hwang · At the Intersection of AI, Governments, and Google - Tim Hwang · Y Combinator · Jun 16, 2017 · at 2:36
Tim Hwang, Google's AI policy lead, explains the tension between collecting diverse datasets to prevent algorithmic bias and protecting demographic privacy.
0:00 / 0:30exact quote · 30.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Once a machine learning system is behaving in a biased way, one way of trying to deal with it is collecting more diverse data. Okay. But one of the big problems is when you do that, you end up collecting lots and lots of data about minorities, which raises all these really interesting questions around Privacy and then what have you. And that ends up being a really interesting problem because it's both a technical challenge, right? Which is like, can you collect an adequately diverse data set? But on the other hand, like also this policy question, which is what is society comfortable with you collecting? And like, what are the practices? And that ends up being a really interesting trade off that you have to navigate if you're interested in these problems.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Tim Hwang
Hwang: AutoML could eliminate the need for machine learning specialists
“This emerging research right now, which is using machine learning to train machine learning systems, raises, like, this meta level, where, like, right now there's a lot of handwork that goes into building a model so it learns the right representations, but, li…”
Hwang: Open publishing should be the default standard in AI research
“I'm very pro open publishing. Like, I think, like, it should be the default, and it's like, I'm still disputing situations where I'm like, you shouldn't publish on this stuff. Just because like, I think it is actually to the benefit of everybody to know what t…”
Hwang: The assumption that all automatable tasks will be automated is false
“Everybody always assumes that like, okay, if it can be automated, it definitely will be automated, right? But that's like a fallacy, because in certain cases, like, you may really worry about the security of your systems, right?”
Hwang: GDPR introduces a potential right to explanation for automated decisions
“So, one of the most interesting aspects of the GDPR, which is a new privacy regulation in Europe, is the potential for this, what they call kind of a right to explanation. So the idea is, for certain kinds of automated decision making, it might be so significa…”
Hwang: The AI competitive moat is shifting from data to interface design
“The amount of data you need to pull off certain types of machine learning applications is going down over time. And what that tells me is that there might not be necessarily a first-mover advantage in this space, where you may actually have collected a bunch o…”
Hwang: The public sees non-ML robots as AI, ignoring newsfeeds
“The newsfeed assuredly is AI, right? Like, it uses machine learning. It uses the latest machine learning to do what it does. We don't really think about it as AI, right? Whereas, like, the car is, like I mean, I think a lot of robots kind of fall into this cat…”