Apache Airflow Architecture 101
Ғылым және технология
Apache Airflow is a popular open-source Linux and Python based workflow engine. Before you jump in and start using it, there are some things you need to know. In this video, I explain the Airflow architecture: the good, the bad, and the ugly, so you can decide where and when to use it.
Join my Patreon Community and Watch this Video without Ads!
www.patreon.com/bePatron?u=63...
Slides
github.com/bcafferky/shared/b...
Video: Don't Use Apache Airflow
• Don't Use Apache Airflow
Follow me on Twitter
@BryanCafferky
Пікірлер: 11
The best intro regarding Airflow I found. Thank you...
I really appreciate the parsimony segment. Very helpful, thanks.
Nice explanation
Awesome!
Hi, great and helpful video, is there a reliability strategy between the scheduler and the dag directory? It seems that's the signal point of the fail point. Thanks!!!
@BryanCafferky
7 ай бұрын
Not sure but I think the Airflow UI is where failures are expected to surfaced. But good question.
How do you feel about “Prefect”? They’re trying to replace Airflow. A video on Prefect from you would be great too!
@BryanCafferky
Жыл бұрын
Do you need a WorkFlow engine?
@joshi1q2w3e
Жыл бұрын
@@BryanCafferky yes
would airflow be an alternative for ssis/ssdt?
@BryanCafferky
Жыл бұрын
Hi Nathan, See my other vide to answer that. Video: Don't Use Apache Airflow kzread.info/dash/bejne/i4Vkl5h-e92pqdo.html