Learn OPEN TABLE FORMAT before it's TOO LATE | Modern Data Engineering 2025

Delta Lake | Apache Spark | Databricks | Apache Iceberg | Apache Hudi

This video is a complete beginner-friendly course on Open Table Formats like Delta Lake, Apache Iceberg, and Apache Hudi, using Databricks, PySpark, and Azure Data Lake.

Timestamps:
0:00 Introduction
05:14 What are Open Table Formats
20:44 Databricks Overview
25:59 Databricks Spark Cluster
28:27 Data Ingestion to Databricks using PySpark
39:37 Delta Lake Explained
47:09 Delta Log Explained
50:06 Delta Tables in Databricks
57:04 Transactions in Delta Log
1:06:44 DML Operations in Delta Lake
1:21:38 Data Versioning in Delta Lake
1:23:28 Time Travel (RESTRORE) in Delta Lake
1:25:53 VACUUM in Databricks with Delta Lake
1:42:27 Schema Changes in Delta Lake Databricks
1:54:26 Spark Optimization Techniques in Delta Lake
2:25:50 Deletion Vectors with Azure Data Lake
2:49:59 Spark Structured Streaming


WATCH MY PREVIOUS VIDEOS
➡️Azure End To End Data Project
https://youtu.be/uc-u_juRg-w?si=sO_CavjnhNaSnZri
➡️Databricks Tutorial
https://youtu.be/7pee6_Sq3VY?si=pPBrTnE2R8PhhHu5
➡️PySpark Full Course
https://youtu.be/94w6hPk7nkM?si=i3u_8ZWkGf6fiGyh

REPOSITORY
➡️GitHub
https://github.com/anshlambagit/OpenTableFormat


=======================================
Join this channel to SUPPORT MY HARDWORK:
https://www.youtube.com/channel/UCu7lQE-L5gzt8aD7zuuufjw/join
=======================================

Connect with ME
LinkedIn - https://www.linkedin.com/in/ansh-lamba-793681184/
Telegram - https://t.me/anshlambadatafam

=========================
For COLLABORATION 👇
anshlambacollab@gmail.com
=========================

⭐Hashtags⭐
#azure #databricks #pyspark