Gong is skeptical of anomaly detection approaches for data quality
Abe Gong · Fireside Chat: Abe Gong (Founder & CEO, Superconductive) with Matt Turck (Partner, FirstMark) · Jun 21, 2021 · at 8:17
Abe Gong, Founder and CEO of Superconductive, evaluates automated anomaly detection versus explicit rules-based testing in data pipelines.
0:00 / 0:04exact quote · 4.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Frankly, I'm pretty skeptical of the anomaly detection approach.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Abe Gong
Abe Gong: No rival project has deeply invested in automated data documentation
“Data documentation is a thing that we consider a really important part of the project and frankly a technology that I don't think anybody else has invested deeply in building.”
Abe Gong: Data quality has become a C-level issue for many companies
“Data quality has kind of bubbled up to the point where it's a C-level issue for a lot of companies”
Abe Gong: Software tests are valuable because they make tacit knowledge explicit.
“You need tests because they make tacit knowledge explicit. They make it very clear what the system is intended to do.”
Abe Gong: Great Expectations guarantees documentation reflects live data state
“Unlike the, like the classic outdated data wiki that most teams have lived with in the past with great expectations, as long as you're running your tests, you know, that your documentation actually reflects the current state of the data, which is kind of a gua…”
Abe Gong calls Hasura 'just add water GraphQL' for Postgres databases.
“It's just add water GraphQL for Postgres. So if you've got a Postgres database, then you can point Hasura at it and extremely quickly spin up a GraphQL API for it. And subscriptions, queries, mutations, like you get all of those things. It's all code gen. So t…”
Abe Gong: Data teams must detect broken dashboards before stakeholders notice
“You can't always completely prevent the dashboard from breaking because it might be because of upstream data that you don't control, but at the very least you want to know about it before your stakeholders know about it.”