Insight certainty 4/5 debate potential 2/5

Kim: Organizations rarely update data models and diagrams after initial creation

Shinji Kim · Automated Data Discovery | Select Star's Shinji Kim · Sep 12, 2022 · at 13:55

Shinji Kim is the Founder and CEO of Select Star. She discusses common user behavior and data documentation decay observed across data teams during a live product walkthrough.

0:00 / 0:12exact quote · 13.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“One of the things that we noticed from observing our users is that they have data models and different diagrams that they've created when they first created the data model, but these things don't get updated.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Shinji Kim

Opinion
Kim: 'Data catalog' is an overused buzzword for a basic tool feature
“I actually think data catalog is a very overused term and also a feature that's available for every modern data tools. Like every data quality or observability tools have a catalog. But catalog really is your schema like map plus search.”
Shinji Kim Sep 12, 2022 ▶ 19:10 Automated Data Discovery | Select Star's Shinji Kim
Prediction Not checkable as stated
Kim: Cloud providers enable an unstoppable corporate drive to collect more data
“And it became very clear to me that companies are not going to stop anytime soon with their desire to collect more data more often, and cloud providers are just allowing them to make that happen more quickly.”
Shinji Kim Sep 12, 2022 ▶ 1:00 Automated Data Discovery | Select Star's Shinji Kim
Insight
Kim: Modern data trends make data discovery painful across entire companies
“So all these market trends combined makes what we call data discovery. Very painful, not just for the data team, but for everyone inside the company.”
Shinji Kim Sep 12, 2022 ▶ 3:06 Automated Data Discovery | Select Star's Shinji Kim
Assertion Not checkable as stated
Kim: Analysts and engineers make up 70% of Select Star's user base
“So today, majority of our user base, I would say about 65 to 70% are data analysts and data engineers.”
Shinji Kim Sep 12, 2022 ▶ 17:02 Automated Data Discovery | Select Star's Shinji Kim
Assertion Not checkable as stated
Kim: Engineers waste massive time searching SQL queries to trace table lineage
“A lot of technical users and data analysts and engineers also ending up spending a lot of time just searching through different SQL queries and trying to find, like, how this table was created, for example.”
Shinji Kim Sep 12, 2022 ▶ 4:06 Automated Data Discovery | Select Star's Shinji Kim
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.