Insight certainty 3/5 debate potential 3/5

Wallach: Data-first research approaches amplify issues with algorithmic bias and fairness

Hanna Wallach · Hanna Wallach, Microsoft Research // Data Driven #33 // Jan 2015 (Hosted by FirstMark Capital) · Jan 15, 2015 · at 10:25

Hanna Wallach, researcher at Microsoft Research, critiques computer science research workflows that prioritize available datasets over core questions.

0:00 / 0:11exact quote · 11.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Although this is kind of conducive to fast-paced work, these data-first or method-first approaches can actually amplify issues related to bias, fairness, and inclusion of minorities.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Hanna Wallach

Insight
Wallach: Tech and government players must hire social scientists to address bias
“So as a result, if technology companies and government organizations, the biggest players in the big data game, Are going to take issues like bias and fairness and inclusion seriously. They need to hire social scientists, the people with the best training and …”
Hanna Wallach Jan 15, 2015 ▶ 6:27 Hanna Wallach, Microsoft Research // Data Driven #33 // Jan 2015 (Hosted by FirstMark Capital)
Insight
Wallach: Big data sets differ from physics data by documenting human behavior
“Unlike the data sets arising in physics, the data sets that typically fall under the big data umbrella are about people, Their attributes, their actions, and their interactions. That is to say these are social data sets that document people's lives, behaviors …”
Hanna Wallach Jan 15, 2015 ▶ 3:44 Hanna Wallach, Microsoft Research // Data Driven #33 // Jan 2015 (Hosted by FirstMark Capital)
Insight
Wallach: Big data's defining feature is granularity, not size
“The issue is granularity. In other words, not only do these data sets document social phenomena, they do so at the granularity of individual people and their second-to-second activities.”
Hanna Wallach Jan 15, 2015 ▶ 4:18 Hanna Wallach, Microsoft Research // Data Driven #33 // Jan 2015 (Hosted by FirstMark Capital)
Assertion Contradicted
Wallach: Research shows diverse teams best facilitate rapid breakthrough innovation
“In fact, there's even substantial research in social psychology and sociology indicating that rapid breakthrough innovations are best facilitated by bringing together people with really diverse backgrounds.”
Hanna Wallach Jan 15, 2015 ▶ 6:13 Hanna Wallach, Microsoft Research // Data Driven #33 // Jan 2015 (Hosted by FirstMark Capital)
Insight
Wallach: Addressing algorithmic bias requires focusing on big data's granular nature
“When it comes to addressing issues like bias, fairness, and inclusion, perhaps we should instead be focusing our attention on the granular nature of big data.”
Hanna Wallach Jan 15, 2015 ▶ 7:20 Hanna Wallach, Microsoft Research // Data Driven #33 // Jan 2015 (Hosted by FirstMark Capital)
Prediction Not checkable as stated
Wallach: The big data game will be won by asking interesting questions
“Ultimately, the big data game will be won by those who know how to ask and answer interesting questions.”
Hanna Wallach Jan 15, 2015 ▶ 9:23 Hanna Wallach, Microsoft Research // Data Driven #33 // Jan 2015 (Hosted by FirstMark Capital)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.