Delta Live Tables Databricks (Full Course) | Crack Data Engineer Interviews in 2025 | PySpark
Welcome to our in-depth 4+ hour video on Databricks Delta Live Tables (DLT), where we explore the powerful features and functionalities that make DLT an essential tool for modern data engineering.
What You'll Learn:
- Databricks Delta Live Tables Pipelines
- Spark Structured Streaming Tables & Materialized Views
- Slowly Changing Dimensions in Databricks
- Incremental Data Loading using Autoloader
- Data Quality Checks in Databricks using Expectations
- PySpark Structured Streaming
- Data Transformations using PySpark
Databricks Unity Catalog : https://youtu.be/P5pEeR3xQpI?si=beQUvqFxaMMVTb4R
Delta Lake Full Course : https://youtu.be/O18afGTGoIU?si=Azqkd8NLGgDhgojs
Azure End To End Data Project : https://youtu.be/6_hXeNg9TJ0?si=9naCovTmgcZn0NQQ
Databricks Tutorial : https://youtu.be/P5pEeR3xQpI?si=XbQYrYkrVp2jKjfE
PySpark Full Course : https://youtu.be/94w6hPk7nkM?si=Y2EUnifXrZRK3MOj
PySpark Interview Ques (2025) : https://youtu.be/fOCiis31Ng4?si=SNSxDEG1m_n8vH1p
Connect with ME - https://www.linkedin.com/in/ansh-lamba-793681184/
Telegram Channel - https://t.me/anshlambadatafam
Telegram Group - https://t.me/+9jR_HQ4YhBMzY2Q1
Timestamps:
0:00 Introduction
08:24 Free Azure Account
10:12 Azure Overview
14:54 Create Azure Data Lake
20:26 Create Azure Databricks Account
27:39 Azure Databricks Overview
35:55 Databricks Unity Catalog
45:35 Create Databricks Spark Cluster
53:15 Creating Delta Tables using PySpark
1:00:39 Delta Live Tables Databricks
1:04:30 DLT Pipeline with Spark Streaming
1:11:34 Create Delta Live Table using Spark Streaming
1:22:41 End-To-End DLT Pipeline using PySpark
1:40:15 Data storage with Delta Live Tables Unity Catalog
1:45:10 Azure Delta Lake
1:51:12 Incremental Data Loading
1:56:38 Creating Streaming View in Databricks
2:07:36 Append Flow in Delta Live Tables
2:30:31 Databricks PySpark Real Time Scenarios
2:35:00 Data Transformation using PySpark
2:40:09 Paramterized DLT Pipeline
2:41:07 Apply changes into delta live tables
2:47:54 Change data capture databricks
2:50:06 Slowly changing dimensions databricks
3:09:47 Data Quality Checks in Databricks using Expectations
3:24:59 Delta Live Tables Spark Job Cluster
3:43:21 Databricks Autoloader
Please Hit the SUBSCRIBE button❤️to support me and my hard work.
For COLLABORATION 👇
anshlambacollab@gmail.com
⭐Hashtags⭐
#azure #databricks #dataengineering #education #pyspark