Ehrlich says legacy data tools cannot handle noisy AI agent data
“So you need tools that are able to both understand data from multiple locations, clean the noise, and make sure all of these data that's been created is actually usable. It doesn't apply with the old tools that were very, some of them were incredible. Five Tro…”
Catanzaro: Built-In Catalog Features in Snowflake and dbt Were Good Enough
“Many of these products offered kind of like data cataloging capabilities as a feature. And I think for humans, that was good enough. Like the data catalog that you had available in Snowflake was good enough. The data cataloging capabilities available in dbt, l…”
O'Driscoll: Fivetran acquiring dbt is a smart combo that reaches IPO scale
“And that's why I think this deal felt to me from a distance, like I'm not the infrastructure guy at scale, but it felt to me from a distance like that's a damn smart, obvious combo. You know, that'll be a good, that, that will get critical mass. I mean, you wo…”
Handy: dbt began as an internal productivity tool for consulting
“Really DBT started out an internal productivity tool to support the consulting business.”
Handy: dbt originally modeled its product design off Terraform
“And so we kind of modeled the original product off of Terraform.”
Handy: Data leaders hosted dbt meetups to expand their hiring pipeline
“One of the weirdest experiences was people in that community that were like, that ran data teams, they would host meetups for dbt to try to convince other people to use dbt because they needed more people to hire.”
Handy: In 2019, 3 dbt engineers supported 1,000 companies driving $100M+ compute
“Even when in 2019, we had a thousand companies using dbt, And continued, you know, three X year over year growth rate. I still didn't want to take venture, but it was so clear we were doing the product and the community a disservice by under investing in it. W…”
Moore: RJMetrics essentially combined early versions of Fivetran, Snowflake, dbt, and Looker
“RJ Metrics was Fivetran, Snowflake, DBT, and Looker. All together in one product. We built all four of those products in order to build RJ Metrics.”
Moore: RJMetrics alumni later founded prominent data companies dbt, Stitch, and Omni
“The three co-founders of DBT all worked at RJ Metrics. The founders of Stitch, myself and Jake, which became the early competitor to Fivetran and played in that space. Omni, which is a hot new ticket in the BI space, their founding CTO, Chris Merrick, was our …”
Handy: The core modern data stack architecture remains a good idea
“When people started using the term modern data stack, there was a there, like fivetran, dbt, mode, looker, et cetera. These are tools that. Were built around an idea of how data technology should work. And it was a, it was, and is a good idea.”
Keydunov: The modern data stack will enter a consolidation cycle
“I feel like right now we should go through the cycle of consolidation. And you know, like I mean, if Fivetrend and dbt merge, they can be alter-ex of a new generation or something like that. And you know, probably some ETL tool to there. But I feel it might ha…”
Zima: Looker could have taken bigger risks aligning with dbt or acquiring
“And I think that we actually made some of those mistakes, even like, I think that we could have taken some big risks to align more closely with DBT or to acquire possibly, or to like move into different areas of the stack that we didn't do. Because we were com…”
Hay: Advanced engineering teams using Snowflake and dbt should adopt reverse ETL
“If you are an advanced engineering Culture, and you are cutting edge, and you're going to do a bunch of modeling in dbt, and you already have Snowflake, you should move towards a model of using a reverse ETL.”
Schottenstein: 20,000 companies use dbt every single week
“20,000 companies using dbt every single week, and that attracts partners to want to build for dbt.”
Stancil: dbt's SQL-based semantic layer is not a real semantic model
“They're moving in, like, the semantic layer tool, so basically they're saying, give us raw data, and we will tell you, like, apply semantics to it. The way that they do that now is through SQL. So, like, semantics are kind of, like, air quote semantics. It's b…”
Stancil: dbt's initial ease of use may become its downfall
“Dbt is, I think, really popular because it's so easy to get up and running, but it may also eventually be, like, if it had an undoing, to me that would be the undoing, is the thing that was really easy to get up and running doesn't actually solve the real prob…”
Pigment signed Figma, dbt, Carta, Brex, and Gong within six months
“Some are actually iconic SaaS brands, so you probably know the Figma, the DBT of this world. Some are very famous brands for CFOs, Carta, Brex. Some are iconic brands for sales team. I can talk about Gong, for instance.”
Handy: Data processing will be polyglot with non-SQL abstractions within five years
“We really do think that the future of data processing is polyglot, and I think that if you look in five years, you will find more robust abstractions on top of data, and even in the DBT ecosystem, than SQL.”
Meroxa bypasses data warehouses to transform data on every real-time event
“What we do this differently is that we act off of every single event. So every time there's a database transaction, somebody calls your API, they interact with your website that, that makes the API call that talks to the database. We can then transform that da…”
Narayan: dbt serves as GitHub for SQL code
“I think of it as like GitHub for all of your SQL, right?”
Narayan: Streaming will remain niche until tooling matches batch systems
“Until streaming gets to the same level of tooling, and a large part of that tooling is dbt as existing batch systems you know, it will still remain a fairly niche technology.”
Steer in 2020: dbt will be the next major data product
“DBT is kind of the product, right? That's going to be the next thing. And if we were going to build it, we would do it the way that they did it.”
Handy: dbt serves batch data workloads, not sub-100ms real-time applications
“There's a lot of data science that's done Internally where like you're doing predictive analysis that, you know, the data latency can be a day or it can be like last quarter's data is fine. And those data science workloads are often run on the exact same stack…”
Handy: dbt's philosophy empowers data analysts to think like software engineers
“Yes, that is completely true.”
Handy: dbt originated as an internal tool for a consulting firm
“First time analytics, my company that is the maintainers of dbt we started as a consulting business and dbt was the tool that I wanted to be able to do this work.”
Handy: The dbt community reached over 8,000 members by late 2020
“We've built this community of over 8000 people today who you know, have bought into this as like the way that they want their careers to look.”
Fraser: dbt has emerged as the standard for data warehouse transformations
“Over the last couple of years, this great tool called DBT, which is an open source community. It's also a product, and there's a company called Fishtown Analytics that's the primary sponsor of DBT, but it's really emerged as the way to orchestrate transformati…”