Gleb Mezhanskiy: Data monitoring scales better than manual data testing
Gleb Mezhanskiy · A Novel Approach to Data Quality for the Modern Data Stack | Datafold’s Gleb Mezhanskiy · Sep 12, 2022 · at 5:45
Gleb Mezhanskiy, founder and CEO of Datafold, compares data quality paradigms in modern data stack architecture at Data Driven NYC.
0:00 / 0:12exact quote · 12.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Data testing is basically us writing unit tests for data are not scalable, whereas data monitoring is scalable because we can just automatically track data in the warehouse and automatically provision machine learning to track data for anomalies.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Gleb Mezhanskiy
Gleb Mezhanskiy: Data testing gives better signal-to-noise than data monitoring
“The signal to noise in data testing typically tends to be better because we define exactly what is wrong, what is right, versus in monitoring, it's Quite noisy, because we just, it just tells us when data doesn't conform to the historical properties, which doe…”