Learn Data Engineering with this 11.5-hour video! It starts by explaining the differences between Data Engineers and Data Scientists. You will learn about the Data Engineering Lifecycle. The video includes hands-on tutorials on Python and SQL. It also covers Big Data technologies like Hadoop and Spark. You’ll explore Cloud platforms such as AWS, CloudFront, HoneyCode, and Amplify. There are demos on AWS HoneyCode and Amplify. Additionally, you will learn about Data Warehousing tools like Amazon Redshift and Snowflake. This guide offers a clear overview of the key skills needed for a career in Data Engineering!
Boost your programming skills with our free Python Fundamentals course for beginners. Learn essential Python concepts and solve real-world problems using Jupyter Notebook. Enroll now to get started!
https://www.mygreatlearning.com/academy/learn-for-free/courses/python-fundamentals-for-beginners?utm_source=CPV_YT&utm_medium=Desc&utm_campaign=DataEnggFulTut_2024
Learn AI & ML from the University of Texas, Austin. To build a successful career enroll now!
https://www.mygreatlearning.com/pg-program-artificial-intelligence-course?utm_source=CPV_YT&utm_medium=PPDesc1&utm_campaign=DataEnggFulTut_2024
Boost your resume with a Generative AI for Business certificate from Microsoft. Enroll now!
https://www.mygreatlearning.com/gen-ai-microsoft-azure-open-ai-online?utm_source=CPV_YT&utm_medium=PPDesc2&utm_campaign=DataEnggFulTut_2024
🏁 Topics Covered:
00:00:00 Introduction
00:01:54 Introduction to Data Engineering
00:03:12 Data Engineer vs Data Scientist
00:04:09 Important Skills for Data Engineering
00:04:41 Data Engineering Lifecycle
00:06:17 Data Structures in Python: Tuple, List, Dictionary & Set
00:32:54 Flow Control Statements
00:50:54 Inheritance in Python
01:42:36 Python Numpy
02:15:26 Python Pandas
02:39:40 Data Visualization with Python: Matplotlib
03:26:45 Data Visualization with Python: SeaBorn
03:46:31 Python Project on IPL Data
04:29:49 SQL - Introduction and Installation
04:32:06 Data Types in SQL
04:34:58 Hands-on based on HR Database Management System
05:31:06 Introduction to Big Data
05:45:58 ETL (Extract-Transform-Load)
06:00:21 Introduction to Hadoop
06:13:59 Distributed Computing
06:22:26 Hadoop Architecture
06:29:20 HDFS File Storage
06:42:25 Introduction to Oozie and HDFS Processing
06:47:45 Hadoop Clusters
07:06:23 Hadoop Ecosystem
07:34:38 Introduction to Spark
07:34:48 Introduction to Real-Time Analytics
07:37:57 Difference between Batch & Real-Time Systems
07:47:34 Input Output Connectors
07:58:54 Twitter Streaming in Real-Time - Demo
08:53:08 What is Data Warehouse for Data Engineer
08:54:03 Need of Data Warehouse
08:54:41 Top Data Warehouse Tools
08:55:59 What is Cloud Computing?
09:00:13 World before Cloud Computing
09:06:50 World before Cloud Computing
09:10:37 Need For Cloud Computing
09:22:15 Working of Cloud Computing
09:29:57 Cloud Providers
09:31:51 Basics of AWS
09:50:53 AWS CloudFront
09:55:42 Demo: AWS CloudFront
10:04:56 AWS HoneyCode
10:06:12 AWS Amplify
10:07:24 Demo: AWS Honeycode & AWS Amplify
10:30:21 Summary
⚡ About Great Learning Academy:
Visit Great Learning Academy to get access to 1000+ free courses with free certificates on Data Science, Data Analytics, Digital Marketing, Artificial Intelligence, Big Data, Cloud, Management, Cybersecurity, Software Development, and many more. These courses are supplemented with free projects, assignments, datasets, and quizzes. At the end of the course, you can earn a certificate of completion for free.
⚡ About Great Learning:
With more than 11 Million+ learners in 170+ countries, Great Learning is a leading global edtech company for professional and higher education offering industry-relevant programs in the blended, classroom, and purely online modes across technology, data, and business domains. These programs are developed in collaboration with top institutions like Stanford Executive Education, MIT Professional Education, Wharton, University of Arizona, Northwestern University, The University of Texas at Austin, NUS, Microsoft & more.
SOCIAL MEDIA LINKS:
🔹 For more interesting tutorials, don't forget to subscribe to our channel: https://glacad.me/YTsubscribe
🔹 For more updates on courses and tips follow us on:
✅ Telegram: https://t.me/GreatLearningAcademy
✅ Facebook: https://www.facebook.com/GreatLearningOfficial/
✅ LinkedIn: https://www.linkedin.com/school/great-learning/mycompany/verification/
✅ Follow our Blog: https://glacad.me/GL_Blog