YouTube Data Analysis | END TO END DATA ENGINEERING PROJECT

➡️ Check Out My Data Engineering Bootcamp: https://bit.ly/3yXsrcy USE CODE: COMBO50 for a 50% discount In this video, you will execute the END TO END DATA ENGINEERING PROJECT using Kaggle YouTube Trending Dataset. If you are someone who wants to learn Data Engineering by doing hands-on projects then this video is for you! 👉🏻Part 2 of the video - https://www.youtube.com/watch?v=qFaaKme5eDE ✨Visit ProjectPro for more projects - https://bit.ly/3iIGfM5 Useful links mentioned in the video - 1. Create Your AWS Account - https://aws.amazon.com/premiumsupport/knowledge-center/create-and-activate-aws-account/ 2. Download AWS CLI - https://aws.amazon.com/cli/ 3. Download Data From Here - https://www.kaggle.com/datasnaek/youtube-new Find Commands and Code Used in the video here - https://github.com/darshilparmar/dataengineering-youtube-analysis-project 👉🏻 Learn Basics (If you don't know) 👈🏻 1. Learn Python From Here - https://bit.ly/3t9pFLx 2. Learn SQL here - https://bit.ly/3KNmUW8 3. Learn Spark and Big Data - https://bit.ly/3telBcW 4. Learn AWS Lambda - https://aws.amazon.com/lambda/ Join Data With Darshil Discord Server: https://discord.gg/dHjvD8JCG3 Timestamps 0:00 Project Introduction (Very Important) 2:22 What You Will Learn 4:57 Understand Dataset That We Are Going To Use 6:16 On-Premise vs Cloud Data Processing 8:50 Create Your AWS Account 9:19 Best Practices To Follow On AWS 9:59 Create IAM Account For Admin 13:15 Install AWS CLI 16:05 Create S3 Bucket and Upload Our Data 22:05 What is Data Lake? 23:40 Understand Data That Got Uploaded 24:45 Build Glue Crawler and Catalog 30:14 Use Athena and SQL to Query Data 32:20 Solving Error and Preprocessing Data 34:57 Writing ETL Job In Lambda and Cleaning Data 42:33 What is AWS Lambda and Layers? 47:51 Querying Our Cleaned Data on Athena 👦🏻 My Linkedin - https://www.linkedin.com/in/darshil-parmar/ 📷 Instagram - https://www.instagram.com/darshilparmarr 🎯Twitter - https://twitter.com/parmardarshil07 🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟 3 Books You Should Read 📈Principles: Life and Work: https://amzn.to/3HQJDyP 👀Deep Work: https://amzn.to/3IParkk 💼Rework: https://amzn.to/3HW981O Tech I use every day 💻MacBook Pro M1: https://amzn.to/3CiFVwC 📺LG 22 Inch Monitor: https://amzn.to/3zk0Dts 🎥Sony ZV1: https://amzn.to/3hRpSMJ 🎙Maono AU-A04: https://amzn.to/3Bnu53n ⽴Tripod Stand: https://amzn.to/3tA7hu7 🔅Osaka Ring Light and Stand: https://amzn.to/3MtLAEG 🎧Sony WH-1000XM4 Headphone: https://amzn.to/3sM4sXS 🖱Zebronics Zeb-War Keyboard and Mouse: https://amzn.to/3zeF1yq 💺CELLBELL C104 Office Chair: https://amzn.to/3IRpiL2 👉Data Engineering Complete Roadmap: https://www.youtube.com/playlist?list=PLBJe2dFI4sgtlK_zaqaIBdJFgieYPnQ07 👉Data Engineering Project Series: https://www.youtube.com/playlist?list=PLBJe2dFI4sgukOW6O0B-OVyX9c6fQKJ2N 👉Become Full-Time Freelancer: https://www.youtube.com/playlist?list=PLBJe2dFI4sgtza0sAnNFwo8KPG0GcO9Il 👉Data With Darshil Podcast: https://www.youtube.com/playlist?list=PLBJe2dFI4sgv_XmEDaXF3z1MNib7R3KUY ✨ Tags ✨ data engineering projects, big data project, data engineering project hands-on, hands-on data engineering projects, learn data engineering, data engineering roadmap, how to become data engineer, data engineering free projects, big data engineering, big data ✨ Hashtags ✨ #dataengineer #project #darshil