Lee Fan: Pinterest tests skin tone detection for personalized visual recommendations
Lee Fan · a16z Podcast | Engineering Intent · Jan 2, 2019 · at 14:16
Lee Fan, an engineering executive at Pinterest, outlines internal machine learning experiments aimed at tailoring product and style recommendations based on user characteristics.
0:00 / 0:13exact quote · 13.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“We have some experiment in-house. If you take a picture of yourself, and we learn your skin tone. But by the way, we can also learn from the pins you like, and we know there's certain style, certain shape of a model you like to see.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Lee Fan
Lee Fan: Individual engineer throughput can differ by 10x to 100x
“Meaning that engineer versus engineer, the throughput can be 10 X or even hundred X difference.”
Lee Fan: Engineering compensation should reflect individual productivity differences
“I also believe that we should reward according to it.”
Lee Fan: Visual discovery on Pinterest differs from Google by lacking objective right answers
“In some way, this is different from Google. There's no right or wrong.”
Lee Fan: Products should expand discovery before driving conversion based on intent
“What we could do as a product is expand your horizon and help you to discover new, interesting ideas. We don't have to push you into deep, say, purchase this or book this. But then later, we can tell users' behavior. They're going narrow and narrow. Now we, I …”
Lee Fan: Computer vision progress in subjective domains is limited by data
“Right now, I will say a lot of domain is limited by the data. If you only have a limited data to teach, let's say fashion, how can we know this is a fashion that are high end and more for the runway instead of a daily? It's a lot of data because it is a subtle…”
Lee Fan: Pinterest trains AI to identify visual cues that make photos inspirational
“We are trained computer to learn why this image of the same living room, you take a picture of this way and that way, that looks so different. One just looks so inspirational. The other, like maybe just boring and the computer will start to learn those cues an…”