Hello All,
Our first full fledged Big Data Bootcamp With Cloud Azure And AWS is live and has started from 21st December 2024.
๐๐ฅ๐๐๐ฌ๐ ๐๐ข๐ง๐ ๐ญ๐ก๐ ๐๐จ๐ฎ๐ซ๐ฌ๐ ๐๐๐ญ๐๐ข๐ฅ๐ฌ ๐๐๐ฅ๐จ๐ฐ
๐๐ข๐ ๐๐๐ญ๐ ๐๐ข๐ญ๐ก ๐๐ณ๐ฎ๐ซ๐ ๐๐ง๐ ๐๐๐ ๐๐ฅ๐จ๐ฎ๐ ๐๐๐ฌ๐ญ๐๐ซ๐ฒ ๐๐ซ๐จ๐ ๐ซ๐๐ฆ
๐๐๐ง๐ญ๐จ๐ซ: Mayank Aggarwal
๐๐ญ๐๐ซ๐ญ ๐๐๐ญ๐: ๐๐๐๐๐ฆ๐๐๐ซ 21๐ฌ๐ญ 2024
๐๐ข๐ฆ๐ข๐ง๐ : 8๐๐ฆ ๐ญ๐จ 12๐ฉ๐ฆ ๐๐๐(๐๐๐ญ๐ฎ๐ซ๐๐๐ฒ ๐๐ง๐ ๐๐ฎ๐ง๐๐๐ฒ)
๐๐ซ๐จ๐๐ข๐๐ข๐๐ง๐๐ฒ ๐๐๐ฏ๐๐ฅ - ๐๐ซ๐จ๐๐๐ฌ๐ฌ๐ข๐จ๐ง๐๐ฅ๐ฌ (2+๐ฒ๐๐๐ซ๐ฌ ๐๐ฑ๐ฉ๐๐ซ๐ข๐๐ง๐๐)
Please find the course details below,
https://bit.ly/41d7c1Q
Code for this project: https://github.com/mayank953/BigDataProjects/tree/main/Project-Brazillian%20Ecommerce
Timestamp
00:00:00 Project Introduction
00:50:00 Getting Started
02:34:00 Pre-requisite
08:34:00 Project Architecture
00:20:00 Azure Free Account
00:27:00 Azure Cloud
00:34:37 Olist Dataset
00:42:00 SQL DB & Data Ingestion
01:06:30 Role of Data Engineer
01:11:24 Resource & Resource Group
01:12:24 Azure Data Factory
01:31:00 ADLS storage account
01:41:00 Meddallion Architecture
01:46:23 Ingestion with ADF
02:00:46 Real Time Ingestion with ADF
02:26:49 Parametrized Ingestion ADF
02:42:00 Azure Databricks Creation
02:43:21 Databricks Overview
02:51:36 Databricks UI Overview
02:58:12 Compute and Notebook
03:00:00 MongoDB & Ingestion
03:08:10 Databricks Workflow
03:12:12 Datbricks to ADLS connection
03:25:12 Accessing data from Lake
03:30:02 Outro & Next Part