Brundage: Responsible disclosure norms are missing for AI adversarial vulnerabilities
Miles Brundage · A.I. Policy and Public Perception - Miles Brundage and Tim Hwang · Y Combinator · Apr 25, 2018 · at 1:31
Miles Brundage, AI Policy Research Fellow at Oxford's Future of Humanity Institute, discusses security frameworks in his co-authored report 'The Malicious Use of Artificial Intelligence.'
0:00 / 0:24exact quote · 24.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“So things like responsible disclosure, when you find out about a new vulnerability is something that's pervasive in the computer security community, but hasn't yet been seriously discussed for things like adversarial examples, where you might want to say, hey, there's this new misuse opportunity or way in which you could fool this, like, commercial system that is currently you know, running driverless cars or whatever, and so there should be some more discussion about those sorts of issues.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Miles Brundage
Brundage: Scalable AI vulnerability discovery could cause a catastrophic cyber attack
“It could be that you know, something truly catastrophic could happen if you sort of combine the, Scalability of AI and digital technology in general with, like, the adaptability of human intelligence for, like, finding vulnerabilities. If you put those togethe…”
Brundage: Reducing AI existential risk by 0.1% preserves massive expected value
“Reducing the probability of existential risk is super important, even if AI is you know, decades or centuries away, and even if we can only, you know, decrease the probability, you know, of that happening by, like.1% or whatever in expectation, that's, like, a…”
Brundage: Technical transparency in AGI could enable international non-aggression pacts
“And I think if you actually had the full development of the FAT methods, and you had accountability and transparency for even general AI systems or superintelligent systems, I think that would open up the door for a lot more collaboration. If you could sort of…”
Brundage: AGI accountability may be easier than thought if corrigibility stabilizes feedback
“Corrigibility, what he calls corrigibility, and what others have called corrigibility, might actually be, like, a stable basin of attraction, in the sense that if a system, you know is designed in such a way that it's able to, like, take critical feedback, and…”
Brundage: China will not slow AI deployment over interpretability concerns
“In China, there's, like, much let, or I haven't seen as much concern about interpretability, though there are some, like, good papers coming out of China, but in terms of, like, governance, I haven't gotten the sense that they're gonna, like, hold back the dep…”
Brundage: AI Governance Lacks the Methodological Rigor of Climate Science
“People have been talking about AI AI ethics and AI governance for a long time, but there hasn't been much dialogue between, you know, this world and then the other worlds of, like, you know, science policy and public policy, and, you know, one way to think abo…”