Babineau: Data scientists' biggest mistake is assuming data is clean and perfect
Michael Babineau · Analyzing Billions of Transactions to Understand Consumer Behavior - Michael Babineau and Kevin Hale · Y Combinator · May 29, 2019 · at 33:57
Michael Babineau, co-founder and CEO of Second Measure, explains the most common pitfall candidates make during technical data science interviews.
0:00 / 0:10exact quote · 10.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I'd say the, like, the number one mistake that people make is that they you know, they assume too much of the data. They assume the data's perfect, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Michael Babineau
Lapsed Amazon Prime subscribers continue spending more than they did before subscribing
“People who became an Amazon Prime subscriber, even if they lapse, right, even if they are no longer a subscriber they're still spending more on Amazon after than they did before.”
Most hedge funds operate without any in-house coders, Michael Babineau says
“In reality most most hedge funds have a handful of analysts and just some back office support, right? They don't have any coders in house.”
Investors generally lack the technical skills to process messy credit card data
“Credit card transaction data is, it's a messy and, like, there, it's a messy data set with unstructured data problems baked into it. And the skill sets of investors, even the more technical ones those tend to lean more towards, like, time series analysis as op…”
Most Bay Area venture capital firms are Second Measure customers, Babineau claims
“And now most most of the VCs here in the Bay Area, they are our customers, you know”
Stitch Fix did not cannibalize department store spending, Second Measure found
“And what we found is that Stitch Fix had
no impact on department store spend.
Right?
People just started spending more on clothes.
Period.”
Peloton monthly active members have surpassed SoulCycle riders, Second Measure data shows
“I mean, the short version is that Peloton has now surpassed SoulCycle in terms of, like, the number of active Peloton members, right, and this is based on a spending based on spending behavior. Active Peloton members on a monthly basis have surpassed the numbe…”