Apache Airflow, every mention
35 scenes, the whole family · ← back to Apache Airflow
tap a year for its mentions
every year anyone Viraj Parekh 22Matt Turck 15Ben Rogojan (Seattle Data Guy) 12Pete DeJoy 11Julien Le Dem 3Jack Hanlon 2Gleb Mezhanskiy 2Florian Douetteau 2Benn Stancil 2Tristan Handy 1
Verbatim, from the transcripts: the passages where Apache Airflow comes up
Understanding Data Engineering in 2025 | Ben Rogojan, Seattle Data Guy
- ▶ 8:50 Ben Rogojan (Seattle Data Guy) I think the other place you often see overlap, um, I wrote an article about this or had someone else write an article and I shared it, but they talked about, it was like Riot Games or one of the ways where one of the teams at Riot Games… 3 times in the scene
- ▶ 9:20 Ben Rogojan (Seattle Data Guy) and you're just using, uh, some tool again, like Airflow to, to run that.
- ▶ 13:55 Ben Rogojan (Seattle Data Guy) Uh, at Facebook, you essentially have your internal airflow that a different team runs, and you can just push files to it, uh, and it picks up the data pipelines, you know, automatically. 2 times in the scene
- ▶ 22:22 Matt Turck And I think you mentioned Airflow earlier in the conversation, is that, uh, which is an orchestration framework. 2 times in the scene
- ▶ 34:47 Ben Rogojan (Seattle Data Guy) And then what a lot of people would end up doing is just essentially building Airflow, um, but internally. 2 times in the scene
- ▶ 37:56 Ben Rogojan (Seattle Data Guy) So they're kind of getting to the point where it's like, okay, now you're getting into this like dbt Airflow-esque space where maybe, yeah, you could be everything. 3 times in the scene
- ▶ 49:54 Ben Rogojan (Seattle Data Guy) So, um, I, I have a soft spot always for airflow, just because that's kind of the first tool I ran into that made my life easier.
Can AI Infrastructure Work Like Magic? Erik Bernhardsson, CEO, Modal
- ▶ 10:34 Erik Bernhardsson Uh, then I like stopped really caring about in 2015, like Airflow kind of took over, and then like later, now there's like Daxter, and Prefect, and Flight, and a bunch of other ones.
Startup to Industry Standard: Lukas Biewald Explains How W&B Scaled MLOps for OpenAI, NVIDIA & More
- ▶ 45:45 Lukas Biewald Today, I have to use Airflow to, like, understand Airflow.
Build Fast APIs Faster Over Data at Scale | Tinybird Founder & CEO Jorge Gomez Sancha
- ▶ 6:01 Jorge Gomez Sancha Airflow or something like that that will move it into some low latency database, and then you still need to build an application and APIs and a back end and a front end, and if you look at all of the handoffs that need to happen, not just…
Separating Data Hype From Substance | Fireside Chat with Mode Co-Founder Benn Stancil
- ▶ 10:43 Benn Stancil Airflow acquired, not Airflow, Astronomer acquired a company in the middle of it.
- ▶ 35:21 Benn Stancil There's this whole, is Airflow being unbundled or rebundled or bundled in a different way, ah, kind of conversation six months ago.
Modern Data Orchestration | Astronomer Co-Founders Pete DeJoy & Viraj Parekh
- ▶ 0:19 Viraj Parekh Uh, right now I'm field CTO, and I help to make sure that the ecosystem around AirFloan Astronomer is well and thriving. 2 times in the scene
- ▶ 3:20 Viraj Parekh And you know, a lot of times companies pick Airflow as the center of their orchestration strategy. 6 times in the scene
- ▶ 4:25 Viraj Parekh And, you know, Airflow was designed for this kind of Python-based job scheduling, but if we think about the personas we went through before, that's really only the first step, and orchestration's a little more than that, or a lot more than…
- ▶ 6:28 Viraj Parekh And you know, over the last half decade or so, Pete and I have talked to probably no less than thousands of data teams and Airflow users all around the world at all sorts of different companies. 5 times in the scene
- ▶ 11:07 Pete DeJoy Are all of these deployments of Apache Airflow, right? 5 times in the scene
- ▶ 16:04 Pete DeJoy Um, we actually have CI set up to auto deploy this DAG now to a live instance of Airflow that is running on Astro, um, and we actually have this set up such that when we
- ▶ 16:36 Pete DeJoy If I flip over to now my airflow deployments, which I showed briefly earlier, this is the airflow instance that just got rebuilt based on that new, um, push. 5 times in the scene
- ▶ 20:14 Viraj Parekh Um, we've been working and talking to data teams for a while now, and we really centered on Airflow as our mission back in 2018. 8 times in the scene
A Novel Approach to Data Quality for the Modern Data Stack | Datafold’s Gleb Mezhanskiy
- ▶ 2:56 Gleb Mezhanskiy For example, your Airflow orchestrator scheduler is broken, or your cluster, like Spark cluster is underwater and backlogged, or your vendor that you use to buy data ships to something which is, ah, of low quality.
- ▶ 3:55 Gleb Mezhanskiy If you're familiar with modern data stack, DBT Airflow, the general ecosystem,
The Next Layer of the Modern Data Stack | dbt's Tristan Handy
- ▶ 13:12 Tristan Handy And so, I really think that, you know, you look at the launch of Airflow in twenty-fifteen, I think it was twenty-fifteen, um, and it was this great kind of container, it was just like,
Fireside Chat: Mark Grover (Co-Founder & CEO, Stemma) with Matt Turck (Partner, FirstMark)
- ▶ 1:06 Mark Grover Then we have said, okay, through various different systems like Airflow and DBT, you can now transform more data.
Fireside Chat: DeVaris Brown (Founder & CEO, Meroxa) with Matt Turck (Partner, FirstMark)
- ▶ 7:45 DeVaris Brown You have to manage your ETL layer like Airflow or, you know, all these different things.
Fireside Chat: Nick Schrock (Founder & CEO, Elementl) with Matt Turck (Partner, FirstMark)
- ▶ 18:04 Matt Turck So there's Airflow 6 times in the scene
Fireside Chat: Dave Burgess (Head of Data Engineering, Pinterest) w/ Matt Turck (Partner, FirstMark)
- ▶ 8:28 Dave Burgess And then we have a workflow system on top of that that's built with Airflow, which is also open source.
- ▶ 29:06 Matt Turck Can you please speak more to use of Kafka and airflow? 6 times in the scene
Fireside Chat: Jack Hanlon (VP Data, Reddit) with Matt Turck (Partner, FirstMark)
- ▶ 10:10 Jack Hanlon Like most people, we have a love-hate relationship with Airflow and things of this nature. 2 times in the scene
Introducing Kedro
- ▶ 6:29 Kedro Product Manager We'll leave those tools to Dagster, Airflow, Prefect, Luigi, and many others to actually handle for you, because they do that really well.
Data Observability and Pipelines: OpenLineage and Marquez
- ▶ 7:35 Julien Le Dem You know, so I talked to Wes, uh, obviously, uh, we like spark contributors, um, GBT and all the, the air flow and all the very, um, popular frameworks to schedule and process data. 2 times in the scene
- ▶ 26:10 Julien Le Dem Um, DBT, uh, Airflow, um, Prefect, um, like, um, I'm missing other things.
Fireside Chat: Jeremiah Lowin (Prefect), Tristan Handy (dbt) with Matt Turck (Partner, FirstMark)
- ▶ 29:02 Matt Turck And how do you, uh, compare and contrast this versus, um, you know, airflow and, and other, uh, products in the space?
How to Answer Data Questions Without Being Miserable // Ahmed Elsamadisi, Narrator (Data Driven NYC)
- ▶ 2:52 Ahmed Elsamadisi We use Luigi, switch dbt, then Airflow, and then ended up building our own solution to handle our dependencies.
The Launch of Dataiku 5 // Florian Douetteau, Dataiku (FirstMark's Data Driven NYC)
- ▶ 11:53 Florian Douetteau And so, to, to introduce a subject, well, like, there are two projects that I really like, open source projects, Airflow and JupyterLab, and I think that most of you know them. 2 times in the scene