Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more!
🏆 BECOME A PRO WITH AIRFLOW: https://www.udemy.com/course/the-complete-hands-on-course-to-master-apache-airflow/?couponCode=4677CF7EF58D6AAD9A0C
In the Retail data pipeline project, you will learn:
➡️ How to create a data pipeline in Airflow from scratch
➡️ How to set up your Airflow local environment with the Astro CLI
➡️ How to run data quality checks in your pipeline with Soda
➡️ How to integrate dbt and run your models with Airflow and Comos
➡️ How to isolate tasks to avoid dependency conflicts
➡️ How to upload a CSV file into Google Cloud Storage
➡️ How to ingest data into a BigQuery table using the Astro SDK
and more!
This a complete 1hr project just for you ❤️
Here are the steps with the code snippets:
https://robust-dinosaur-2ef.notion.site/PUBLIC-Project-af398809b643495e851042fa293ffe5b?pvs=4
Fasten your seatbelt, take a deep breath, and.... let's go!