Mini Data Engineering Project: Monitor Apache Airflow with Airbyte, Snowflake, and Superset

Mini Data Engineering Project: Monitor Apache Airflow with Airbyte, Snowflake, and Superset

Notion Page: https://robust-dinosaur-2ef.notion.site/PUBLIC-Mini-Data-Engineering-Project-Monitoring-Airflow-DAGs-and-Tasks-with-Airbyte-and-Snowflake-1159e45d4dbe80c8acb7cbda3cf9e7b9?pvs=4

In this video, you will build a dashboard to monitor your Airflow instance using different metrics.
You will learn:
✅ Using the Airflow REST API to build metrics
✅ Extracting data from your Airflow instance using Airbyte
✅ Creating an Airflow connector with the Airbyte AI Builder
✅ Storing data of your Airflow instance into Snowflake with Airbyte
✅ Defining metrics to monitor with Superset
✅ Running Airflow in the cloud with Astronomer
and more!

Enjoy ❤️