Mar 18, 2016 · 20m · mad

Combining Machine Learning With Expert Human Judgement // Eric Colson, Stitch Fix

Eric Colson · 15m spoken Matt Turck · 55s spoken Podcast Jingle · 2s spoken
0:00 / 0:00
▶ Watch on YouTube →

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

In this DataDrivenNYC presentation, Eric Colson, Chief Algorithms Officer at Stitch Fix, details how combining algorithmic machine computation with human intuition creates a superior hybrid recommendation engine. Through keynote insights and a fireside Q&A with host Matt Turck, Colson illustrates how Stitch Fix leverages human-machine synergy to deliver personalized e-commerce experiences at scale.

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Matt holds 4.9% of the talking time here. How this is scored →

Matt as informed peer 1.0 Guest teaching 0.8 Guest disagreement 0.5 Matt pushing back 0.5
05100:0010:0020:000:08–3:42 · Matt as informed peer 0/10 Comparing Human Perception and Machine Computation Capabilities This is a solo presentation segment by Eric Colson where the host is completely absent. Colson demonstrates computer vision vs human perception using audience participation examples.3:42–7:35 · Matt as informed peer 0/10 Programmatic Access to Human Computation and Brain Power Colson continues his keynote presentation without host participation, explaining programmatic human computation and Stitch Fix's core e-commerce model.7:35–11:54 · Matt as informed peer 0/10 Hybrid Architecture: Integrating Machine Algorithms with Human Stylists Colson delivers a monologue detailing the technical pipeline combining machine matrix factorization and neural networks with expert human stylists.11:54–14:23 · Matt as informed peer 0/10 Training Synergistic Algorithms and Enabling Human Empathy Monologue presentation concluding Colson's talk, focusing on algorithm training and how machine automation frees human stylists to express empathy.14:23–16:42 · Matt as informed peer 5/10 Fireside Discussion: Tech Stack, Infrastructure, and Data Team Scale Host Matt Turck joins for a fireside exchange, asking about the data stack and noting that employing 65 PhDs while still needing human stylists illustrates current machine limits. Colson gently reframes that they do not attempt to make machines act like humans, keeping the dynamic highly collaborative.16:42–20:35 · Matt as informed peer 1/10 Audience Q&A: Feedback Loops, Data Sources, and Target Demographics Matt Turck acts strictly as Q&A moderator while audience members ask Colson technical and business questions. Colson declines to share proprietary keep rates and clarifies audience assumptions regarding customer demographics.0:08–3:42 · Guest teaching 0/10 Comparing Human Perception and Machine Computation Capabilities This is a solo presentation segment by Eric Colson where the host is completely absent. Colson demonstrates computer vision vs human perception using audience participation examples.3:42–7:35 · Guest teaching 0/10 Programmatic Access to Human Computation and Brain Power Colson continues his keynote presentation without host participation, explaining programmatic human computation and Stitch Fix's core e-commerce model.7:35–11:54 · Guest teaching 0/10 Hybrid Architecture: Integrating Machine Algorithms with Human Stylists Colson delivers a monologue detailing the technical pipeline combining machine matrix factorization and neural networks with expert human stylists.11:54–14:23 · Guest teaching 0/10 Training Synergistic Algorithms and Enabling Human Empathy Monologue presentation concluding Colson's talk, focusing on algorithm training and how machine automation frees human stylists to express empathy.14:23–16:42 · Guest teaching 2/10 Fireside Discussion: Tech Stack, Infrastructure, and Data Team Scale Host Matt Turck joins for a fireside exchange, asking about the data stack and noting that employing 65 PhDs while still needing human stylists illustrates current machine limits. Colson gently reframes that they do not attempt to make machines act like humans, keeping the dynamic highly collaborative.16:42–20:35 · Guest teaching 3/10 Audience Q&A: Feedback Loops, Data Sources, and Target Demographics Matt Turck acts strictly as Q&A moderator while audience members ask Colson technical and business questions. Colson declines to share proprietary keep rates and clarifies audience assumptions regarding customer demographics.0:08–3:42 · Guest disagreement 0/10 Comparing Human Perception and Machine Computation Capabilities This is a solo presentation segment by Eric Colson where the host is completely absent. Colson demonstrates computer vision vs human perception using audience participation examples.3:42–7:35 · Guest disagreement 0/10 Programmatic Access to Human Computation and Brain Power Colson continues his keynote presentation without host participation, explaining programmatic human computation and Stitch Fix's core e-commerce model.7:35–11:54 · Guest disagreement 0/10 Hybrid Architecture: Integrating Machine Algorithms with Human Stylists Colson delivers a monologue detailing the technical pipeline combining machine matrix factorization and neural networks with expert human stylists.11:54–14:23 · Guest disagreement 0/10 Training Synergistic Algorithms and Enabling Human Empathy Monologue presentation concluding Colson's talk, focusing on algorithm training and how machine automation frees human stylists to express empathy.14:23–16:42 · Guest disagreement 1/10 Fireside Discussion: Tech Stack, Infrastructure, and Data Team Scale Host Matt Turck joins for a fireside exchange, asking about the data stack and noting that employing 65 PhDs while still needing human stylists illustrates current machine limits. Colson gently reframes that they do not attempt to make machines act like humans, keeping the dynamic highly collaborative.16:42–20:35 · Guest disagreement 2/10 Audience Q&A: Feedback Loops, Data Sources, and Target Demographics Matt Turck acts strictly as Q&A moderator while audience members ask Colson technical and business questions. Colson declines to share proprietary keep rates and clarifies audience assumptions regarding customer demographics.0:08–3:42 · Matt pushing back 0/10 Comparing Human Perception and Machine Computation Capabilities This is a solo presentation segment by Eric Colson where the host is completely absent. Colson demonstrates computer vision vs human perception using audience participation examples.3:42–7:35 · Matt pushing back 0/10 Programmatic Access to Human Computation and Brain Power Colson continues his keynote presentation without host participation, explaining programmatic human computation and Stitch Fix's core e-commerce model.7:35–11:54 · Matt pushing back 0/10 Hybrid Architecture: Integrating Machine Algorithms with Human Stylists Colson delivers a monologue detailing the technical pipeline combining machine matrix factorization and neural networks with expert human stylists.11:54–14:23 · Matt pushing back 0/10 Training Synergistic Algorithms and Enabling Human Empathy Monologue presentation concluding Colson's talk, focusing on algorithm training and how machine automation frees human stylists to express empathy.14:23–16:42 · Matt pushing back 2/10 Fireside Discussion: Tech Stack, Infrastructure, and Data Team Scale Host Matt Turck joins for a fireside exchange, asking about the data stack and noting that employing 65 PhDs while still needing human stylists illustrates current machine limits. Colson gently reframes that they do not attempt to make machines act like humans, keeping the dynamic highly collaborative.16:42–20:35 · Matt pushing back 1/10 Audience Q&A: Feedback Loops, Data Sources, and Target Demographics Matt Turck acts strictly as Q&A moderator while audience members ask Colson technical and business questions. Colson declines to share proprietary keep rates and clarifies audience assumptions regarding customer demographics.

speaking balance: gold is Matt, purple is the guest (3 minute bins)

0:00 · Matt 0% · guest 100%0:00 · Matt 0% · guest 100%3:00 · Matt 0% · guest 100%3:00 · Matt 0% · guest 100%6:00 · Matt 0% · guest 100%6:00 · Matt 0% · guest 100%9:00 · Matt 0% · guest 100%9:00 · Matt 0% · guest 100%12:00 · Matt 16.6% · guest 83.4%12:00 · Matt 16.6% · guest 83.4%15:00 · Matt 14.9% · guest 85.1%15:00 · Matt 14.9% · guest 85.1%18:00 · Matt 3.4% · guest 96.6%18:00 · Matt 3.4% · guest 96.6%
Sharpest disagreement ▶ 18:09 Refusal to Answer Proprietary Question

Colson directly shuts down an audience member's question regarding selection success rates, stating explicitly that it is too proprietary to answer.

Hardest push from Matt ▶ 15:59 Host Reinterpretation of AI Bottlenecks

Matt Turck pushes an observational thesis, asserting that needing 65 PhDs plus human stylists highlights that AI technology is far from self-sufficient.

Biggest teaching moment ▶ 16:24 Reframing Machine vs Human Philosophy

Colson gently re-educates the host, clarifying that Stitch Fix makes no attempt to replicate human behavior with machines, but rather leverages complementary strengths.

Matt holds his own ▶ 15:59 Host Domain Synthesis

Matt Turck demonstrates strong domain awareness by connecting the scale of Stitch Fix's technical team with the realistic limitations of state-of-the-art machine learning.

the scores for every segment, with the reasoning behind each
ChapterTopicMatt as informed peerGuest teachingGuest disagreementMatt pushing backWhy
Comparing Human Perception and Machine Computation Capabilities 0000 This is a solo presentation segment by Eric Colson where the host is completely absent. Colson demonstrates computer vision vs human perception using audience participation examples.
Programmatic Access to Human Computation and Brain Power 0000 Colson continues his keynote presentation without host participation, explaining programmatic human computation and Stitch Fix's core e-commerce model.
Hybrid Architecture: Integrating Machine Algorithms with Human Stylists 0000 Colson delivers a monologue detailing the technical pipeline combining machine matrix factorization and neural networks with expert human stylists.
Training Synergistic Algorithms and Enabling Human Empathy 0000 Monologue presentation concluding Colson's talk, focusing on algorithm training and how machine automation frees human stylists to express empathy.
Fireside Discussion: Tech Stack, Infrastructure, and Data Team Scale 5212 Host Matt Turck joins for a fireside exchange, asking about the data stack and noting that employing 65 PhDs while still needing human stylists illustrates current machine limits. Colson gently reframes that they do not attempt to make machines act like humans, keeping the dynamic highly collaborative.
Audience Q&A: Feedback Loops, Data Sources, and Target Demographics 1321 Matt Turck acts strictly as Q&A moderator while audience members ask Colson technical and business questions. Colson declines to share proprietary keep rates and clarifies audience assumptions regarding customer demographics.

Statements from this episode (7)

Assertion Supported
Stitch Fix has no browse pages, product pages, or search boxes
“Nowhere on the site or on the app are you gonna find a browse page or a product page or a search box.”
Eric Colson Mar 18, 2016 ▶ 5:01
Assertion Not checkable as stated
100% of Stitch Fix sales pass through its recommendation engine
“100% of what we sell goes through our recommendation engine.”
Eric Colson Mar 18, 2016 ▶ 6:53
Assertion Supported
Stitch Fix employs over 2,500 human stylists
“For humans, we have amassed an army of over 2500 human stylists, right?”
Eric Colson Mar 18, 2016 ▶ 7:54
Disclosure
Stitch Fix tests UI variations to isolate complementary human stylist inputs
“We can reveal it by subtly varying the information we show our humans in this custom UI we built, and we can figure out what pieces of information help them with decisions and which pieces don't, and that way we can ensure that they only make positive contribu…”
Eric Colson Mar 18, 2016 ▶ 12:48
Assertion Partly supported
Stitch Fix employs 65 PhDs on its data science team
“We have a, one of the largest data science teams in Silicon Valley. You have 65 PhDs working on this.”
Eric Colson Mar 18, 2016 ▶ 15:10
Assertion Not checkable as stated
Netflix relies completely on implicit data rather than explicit user feedback
“At Netflix it was like pulling teeth to get the customer to tell you anything about themselves, right? They rely completely on implicit data.”
Eric Colson Mar 18, 2016 ▶ 18:40
Assertion Not checkable as stated
No single demographic segment makes up 1% of Stitch Fix's customer base
“We do not have a single segment that we can claim is, ah, representative of our customer. There's not even a one percent segment. Like our largest, we tried cutting them in every way. There's no rhyme or reason. It's everybody.”
Eric Colson Mar 18, 2016 ▶ 20:16
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.