Technical architecture mirrors organizational structure, requiring coordinated team and system decoupling
Scott Sorensen · Scott Sorensen, CTO of Ancestry.com // Data Driven 19 // October 2013 (Hosted by FirstMark Capital) · Jan 16, 2014 · at 21:52
Scott Sorensen, CTO of Ancestry.com, shares organizational lessons on structuring data science and engineering teams to support complex software architecture.
0:00 / 0:17exact quote · 17.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“It's uncanny how technical architecture follows an organization, and so if you want to decouple systems, you have to decouple the organization. If you want tightly, ah, integrated, if you want something tightly integrated, you have to tightly integrate the organization back to the data science and the engineering teams.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Scott Sorensen
Ancestry embeds data scientists into software teams to ensure production readiness
“What we've found, at least at Ancestry, is that we have to embed our data science Scientists into the actual engineering teams and make them talk every day. It improves the feature engineering, improves the domain knowledge, improves the likelihood that engine…”
Predictive machine learning models are useless if they cannot inform interventions
“One of the key learnings was that just because something's predictive doesn't mean that it's actionable.”
Entity extraction elevated Ancestry's worst-performing data collections into its top 10
“It took what was some of our worst performing collections out of our 30,000, ah, collections, and put some of those collections into our top 10 best, ah, best collections.”
Granting academics access to large datasets creates a data science recruiting pipeline
“If you have a large data set and can make it available for academic research, then you could create yourself a pipeline of potentially good data science candidates because they know how to deal with large amounts of data, but they also know your data pretty we…”