Brundage: Near-term AI fairness issues are fundamentally human value alignment problems
Miles Brundage · A.I. Policy and Public Perception - Miles Brundage and Tim Hwang · Y Combinator · Apr 25, 2018 · at 36:52
Miles Brundage (AI Policy Research Fellow at the Future of Humanity Institute) explains how immediate algorithmic bias issues intersect with long-term AGI alignment.
0:00 / 0:15exact quote · 15.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“You could frame a lot of current issues as value alignment problems, so things around bias and fairness. So I think ultimately, you know, there's a question of how do you extract human preferences, and how do you deal with the fact that humans might not have consistent preferences, and some of them are biased.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Miles Brundage
Brundage: Scalable AI vulnerability discovery could cause a catastrophic cyber attack
“It could be that you know, something truly catastrophic could happen if you sort of combine the, Scalability of AI and digital technology in general with, like, the adaptability of human intelligence for, like, finding vulnerabilities. If you put those togethe…”
Brundage: Reducing AI existential risk by 0.1% preserves massive expected value
“Reducing the probability of existential risk is super important, even if AI is you know, decades or centuries away, and even if we can only, you know, decrease the probability, you know, of that happening by, like.1% or whatever in expectation, that's, like, a…”
Brundage: Technical transparency in AGI could enable international non-aggression pacts
“And I think if you actually had the full development of the FAT methods, and you had accountability and transparency for even general AI systems or superintelligent systems, I think that would open up the door for a lot more collaboration. If you could sort of…”
Brundage: AGI accountability may be easier than thought if corrigibility stabilizes feedback
“Corrigibility, what he calls corrigibility, and what others have called corrigibility, might actually be, like, a stable basin of attraction, in the sense that if a system, you know is designed in such a way that it's able to, like, take critical feedback, and…”
Brundage: China will not slow AI deployment over interpretability concerns
“In China, there's, like, much let, or I haven't seen as much concern about interpretability, though there are some, like, good papers coming out of China, but in terms of, like, governance, I haven't gotten the sense that they're gonna, like, hold back the dep…”
Brundage: AI Governance Lacks the Methodological Rigor of Climate Science
“People have been talking about AI AI ethics and AI governance for a long time, but there hasn't been much dialogue between, you know, this world and then the other worlds of, like, you know, science policy and public policy, and, you know, one way to think abo…”