Welcome to this comprehensive Microsoft Fabric data project using New York City taxi data. This video will guide you through an end-to-end data project, focusing on Data Warehousing, Data Factory, and Power BI.
We'll use TLC Trip record data, stored in a Fabric Data Lakehouse, and transform it through staging and presentation layers using Data Factory activities, Dataflows, and Stored Procedures.
Pre-requisites ✅
- Microsoft Fabric environment,
- Basic SQL, and data warehousing knowledge
Timestamps⌚
00:00:00 Introduction
00:04:32 Downloading the NYC Taxi Data Files
00:06:39 Data Lakehouse Files for Landing Data
00:12:19 Pipeline from Landing to Staging
00:42:16 Dataflow from Staging to Presentation
00:59:18 End to End Data Processing
01:03:33 Semantic Modelling and Power BI
01:07:44 Replacing the Dataflow with a Stored Procedure
Links and Resources 🔗
GitHub wiki: https://github.com/malvik01/Fabric-NYC-Taxi-Data-Project/wiki
NYC Trip Record Data: https://www.nyc.gov/site/tlc/about/tlc-trip-record-data.page
Check out my Udemy Course 📚
- Microsoft Fabric: The Ultimate Guide: https://www.udemy.com/course/microsoft-fabric-the-ultimate-guide/?referralCode=94FDA5B8134E63965E92