Build an End to End Data Pipeline on AWS | AWS Lambda, S3 Bucket, EventBridge Trigger , Marvel Data

Learn how to build a data ingestion pipeline using AWS services like Lambda and S3 in this beginner-friendly tutorial! We'll pull data from multiple sources, including Wikipedia and the OMDB API, to analyze Marvel movies' box office performance. Link to Code: https://github.com/sunjana2199/marvel-aws-pipeline Highlights: - WebScraping with Beautiful Soup - Using AWS Lambda for serverless processing - Storing data in S3 as a data lake - Transforming and cleaning data Follow along and level up your data engineering skills. Don't forget to subscribe for more tutorials! -------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------------- TimeStamps: 00:00 - 01:46 - Introduction 1:46 - Process Flow 03:04 - Get started with AWS 04:05 - Overview of Pipeline 08:10 - Write Function 18:30 - Create S3 Bucket 21:00 - Lambda Function 23:45 - IAM 25:24 - Trigger 26:13 - Conclusion -------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------------------- Let's connect LinkedIn : https://www.linkedin.com/in/sunjana-ramana/