MENU

Fun & Interesting

Code along - build an ELT Pipeline in 1 Hour (dbt, Snowflake, Airflow)

jayzern 221,824 1 year ago
Video Not Working? Fix It Now

How to build an ELT pipeline in 1 hour, using industry standard tools such as dbt, Snowflake and Airflow. This is a live coding tutorial, where I’ll walk you through the thinking process, and show you every step. We’ll cover basic data modeling techniques (fact tables, data marts), snowflake RBAC concepts, and how to orchestrate a dbt project using Airflow. Drop down in the comments section what Data Engineering topics you would like to see in the future! Timestamps ⏰ 0:00 - Intro 1:35 - Setup dbt + Snowflake 7:52 - Configure dbt_project.yml and packages 11:45 - Create source and staging tables 17:41 - Transformed models (fact tables, data marts) 20:25 - Macro functions 24:23 - Generic and singular tests 29:35 - Deploy models using Airflow Live Coding notes 🎴 https://bittersweet-mall-f00.notion.site/Code-along-build-an-ELT-Pipeline-in-1-Hour-dbt-Snowflake-Airflow-cffab118a21b40b8acd3d595a4db7c15 Who am I? 🙋🏻‍♂️ I'm Jay, I love making videos about travel, self-help and tech. I currently work in New York City as a data engineer, but I grew up in Malaysia and lived in the UK when I was 19. Back then, I had no idea what life was about, moving to so many places, navigating career in Tech. Today, I've learned a lot and wanna share my perspective through filmmaking. Socials 📱 linkedin: https://www.linkedin.com/in/jayzern/ insta: https://www.instagram.com/jayzern/ Sub Count: 7,163

Comment