Everything Abe Gong said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Gong is skeptical of anomaly detection approaches for data quality
“Frankly, I'm pretty skeptical of the anomaly detection approach.”
Abe Gong: No rival project has deeply invested in automated data documentation
“Data documentation is a thing that we consider a really important part of the project and frankly a technology that I don't think anybody else has invested deeply in building.”
Abe Gong: Data quality has become a C-level issue for many companies
“Data quality has kind of bubbled up to the point where it's a C-level issue for a lot of companies”
Abe Gong: Software tests are valuable because they make tacit knowledge explicit.
“You need tests because they make tacit knowledge explicit. They make it very clear what the system is intended to do.”
Abe Gong: Great Expectations guarantees documentation reflects live data state
“Unlike the, like the classic outdated data wiki that most teams have lived with in the past with great expectations, as long as you're running your tests, you know, that your documentation actually reflects the current state of the data, which is kind of a gua…”
Abe Gong calls Hasura 'just add water GraphQL' for Postgres databases.
“It's just add water GraphQL for Postgres. So if you've got a Postgres database, then you can point Hasura at it and extremely quickly spin up a GraphQL API for it. And subscriptions, queries, mutations, like you get all of those things. It's all code gen. So t…”
Abe Gong: Data teams must detect broken dashboards before stakeholders notice
“You can't always completely prevent the dashboard from breaking because it might be because of upstream data that you don't control, but at the very least you want to know about it before your stakeholders know about it.”
Abe Gong: Great Expectations assertions execute consistently across Pandas, Spark, and SQL
“The kind of guarantee is any given expectation will execute in any of those environments and it'll execute consistently.”
Abe Gong: Superconductive will permanently keep open-source Great Expectations open
“You know, have committed, will always commit to keeping everything that's in open source, great expectations open.”
Gong: The data ecosystem critically needs a SQL linter like SQLFluff
“The other one that I, I'd point to that I haven't used deeply myself, but I just think is a thing that the world really needs is SQL fluff. SQL FL U F F. And it's a linter for SQL. And I'm just kind of shocked that we have got to 20 21 without there being a, l…”
Superconductive takes a fine-grained rules-based approach to data quality
“We've taken a very rules-based approach in the sense of declaring exactly what you expect of data you know, very fine grained detail.”
Superconductive pivoted from healthcare analytics to open source around 2019
“We actually started in healthcare data analytics and deliberately pivoted the company to open source about two years ago now, when great expectations started to just really take on a life of its own.”
the MAD Podcast 2