The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 6 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Douetteau: Airflow and JupyterLab don't go far enough for enterprise data science
“Those two projects are, like, very interesting, but to some extent don't go far enough, because what you really want, at the end of the day, is the ability to capture, within the platform, everything related to, ah, to your data science project.”
Ben Rogojan: Non-Big Tech data engineers must manage their own pipeline tooling
“At Facebook, you essentially have your internal airflow that a different team runs, and you can just push files to it and it picks up the data pipelines, you know, automatically. Whereas in most other companies, you might be the person that has to even manage,…”
Prefect founder Jeremiah Lowin launched it after facing constraints changing Airflow
“Jeremiah was a primary contributor to Airflow, wanted to make some changes, wasn't able to do so, and went and started went and started Prefect.”
Kedro leaves pipeline scheduling and failure monitoring to Airflow and Dagster
“How, what time will this pipeline run? How will I know if it failed? We'll leave those tools to Dagster, Airflow, Prefect, Luigi, and many others to actually handle for you, because they do that really well.”