Microsoft Fabric Spark Notebook - Learn PySpark and SparkSQL in 2hr(Beginners Course) #microsoft

Microsoft Fabric End to End Solution - PySpark and SparkSQL Full Course For Beginners Note:- Download the whole folder Dataset and Code Link- https://1drv.ms/f/s!Ak57yG1_Qg0iey_2DKTSnObu6Ts?e=QyMSNr ----- Video Outline ----- 0:01 Introduction 0:15 Loading File From You Local System to Lakehouse 1:40 Reading CSV File Using PySpark in Microsoft Fabric Notebook 4:02 Select and SelectExpr Function in PySpark 7:30 WithCoumn, WithColumns and WithColumnRenamed Function in PySpark 13:02 Where and Filter Function in PySpark 15:38 GroupBy and Aggregation Function in PySpark 19:45 Joining Two Dataframes Using PySpark 25:34 Union and UnionByName in PySpark 32:06 Drop, DropDuplicates and Distinct Function in PySpark 40:17 Write/Load data to a delta Table and Parquet File Using PySpark 45:16 Overwrite, Append , Ignore and Error Write Mode in PySpark 53:40 Create Delta Table and Load Data through Dataframe in PySpark 01:00:34 Create Delta Table with Partition and Load Data into it Using Dataframe in PySpark 01:10:57 Difference Between Managed and External Table 01:19:34 Create delta table using SparkSQL 01:23:15 Create delta table with Partition using SparkSQL and Insert Data from a View 01:28:48 DML Operations over a delta table using SparkSQL 01:34:17 Temporary and Global Reporary View in PySpark 01:38:32 Data Transformation Over a delta table using SparkSQL 01:50:01 Reading Delta table using PySpark and SparkSQL Microsoft fabric data pipeline script activity: https://www.youtube.com/watch?v=gxoAWCtP07I Microsoft Fabric data Lakehouse end to end project - https://www.youtube.com/watch?v=gKdlsHm7QgU&list=PL9SoC_dDpQ8FnIJZwlk5L4rU1r7-cQNCG If you want to know more about Microsoft Fabric data Warehouse, Please watch below videos- 1. Create Microsoft Fabric Data warehouse: https://www.youtube.com/watch?v=eFSrun_IhtA 2. load data into Microsoft Fabric data warehouse using Data Pipeline: https://www.youtube.com/watch?v=Lk_Tt6qrDH0 3. Create table in Microsoft Fabric data warehouse: https://www.youtube.com/watch?v=WkVbKcZjgHU 4. load data into Microsoft Fabric data warehouse using Copy into Command: https://www.youtube.com/watch?v=WkVbKcZjgHU 5. Transform and load data into Microsoft Fabric data warehouse using T-SQL Procedure - https://www.youtube.com/watch?v=Ew86sP4PZWw