Airflow DAG dependencies: The Datasets, TriggerDAGRunOperator, and ExternalTaskSensor

Data with Marc 15,946 lượt xem 2 years ago

Video Not Working? Fix It Now

Airflow DAG dependencies: The Datasets, TriggerDAGRunOperator and ExternalTaskSensor

A DAG dependency in Apache Airflow is a link between two or multiple data pipelines.
There are three ways of creating DAG Dependencies in Apache Airflow:
👉 Datasets
👉 TriggerDagRunOperator
👉 ExternalTaskSensor
In this video, you will discover an overview of those 3 ways and how to use them.

Materials: https://robust-dinosaur-2ef.notion.site/Airflow-DAG-dependencies-Datasets-TriggerDAGRunOperator-and-ExternalTaskSensor-ce5c25632df54e1aa720bf6aad0aee3d

🏆 BECOME A PRO: https://www.udemy.com/course/the-complete-hands-on-course-to-master-apache-airflow/?couponCode=BIGPROMO1

👍 Smash the like button to become an Airflow Super Hero!
❤️ Subscribe to my channel to become a master of Airflow

🚨 My Patreon: https://www.patreon.com/marclamberti

Enjoy ❤️

dag dependencies

dag dependency

apache airflow

airflow

dag

airflow dag

marc lamberti

Comment