Hwang: Google is researching federated learning for on-device ML training
Tim Hwang · At the Intersection of AI, Governments, and Google - Tim Hwang · Y Combinator · Jun 16, 2017 · at 33:51
Tim Hwang, Google's Global Public Policy Lead on AI, discusses Google's research into decentralized edge computing and on-device training.
0:00 / 0:34exact quote · 34.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“So we're actually working on a little bit of research around that. I haven't played around with it myself, but for example, there's a couple of papers around what they call federated learning, where we're just exactly working on this premise, which is the bet is, okay, well, what happens in a future where the edges of our network, like the phones, like have way more powerful processing power? Like, is it possible for us to basically do the majority of the training For these systems, like on device, and with like basically a lot less data kind of like flowing into the cloud. And the idea was basically like the local model would update, and it would share its learnings with all the other devices in the network.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Tim Hwang
Hwang: AutoML could eliminate the need for machine learning specialists
“This emerging research right now, which is using machine learning to train machine learning systems, raises, like, this meta level, where, like, right now there's a lot of handwork that goes into building a model so it learns the right representations, but, li…”
Hwang: Open publishing should be the default standard in AI research
“I'm very pro open publishing. Like, I think, like, it should be the default, and it's like, I'm still disputing situations where I'm like, you shouldn't publish on this stuff. Just because like, I think it is actually to the benefit of everybody to know what t…”
Hwang: The assumption that all automatable tasks will be automated is false
“Everybody always assumes that like, okay, if it can be automated, it definitely will be automated, right? But that's like a fallacy, because in certain cases, like, you may really worry about the security of your systems, right?”
Hwang: GDPR introduces a potential right to explanation for automated decisions
“So, one of the most interesting aspects of the GDPR, which is a new privacy regulation in Europe, is the potential for this, what they call kind of a right to explanation. So the idea is, for certain kinds of automated decision making, it might be so significa…”
Hwang: The AI competitive moat is shifting from data to interface design
“The amount of data you need to pull off certain types of machine learning applications is going down over time. And what that tells me is that there might not be necessarily a first-mover advantage in this space, where you may actually have collected a bunch o…”
Hwang: The public sees non-ML robots as AI, ignoring newsfeeds
“The newsfeed assuredly is AI, right? Like, it uses machine learning. It uses the latest machine learning to do what it does. We don't really think about it as AI, right? Whereas, like, the car is, like I mean, I think a lot of robots kind of fall into this cat…”