🎓 Check out my FREE web scraping course 👉 https://codematetv.com/courses/web-scraping-for-infants-your-first-steps-with-python-and-requests/
In this video, I walk you through how I scraped data for 4,000 products using Python without any paid proxies! 🌐🔍
The script utilizes popular libraries like requests for making web requests, BeautifulSoup for parsing HTML, and json for saving data. With randomized user agents 🖥️, a sleep mechanism 💤, and headers, I avoided detection while extracting key product info like category, name, price, description, images, and features. 📦📊
💡 The data is saved in an easy-to-access JSON file format. Watch how it all works and get tips on web scraping without proxies! 👀
🔗 Check out the code on GitHub: https://github.com/itishosseinian/paid-project-story-final-part.git
🌐 Target website: https://www.construct-online.ch/
🚀 Join the Telegram group where I found this project, and ask your questions about web scraping:
👉 https://t.me/webscrapingpy
💼 Watch my Upwork paid project playlist to see more stories:👉 https://www.youtube.com/playlist?list=PLrymJLD7fhq_CYIm8dxjkPbl9LrN436oK
00:00 - Intro and preparation
01:24 - How to stay undetected without using proxy
05:58 - How to use a parser for html
12:25 - How to grab product categories in html bs4
18:46 - How to take product code using bs4
22:07 - How to extract price and details. works for all e commerce sites
30:25 - How to scrape tables
35:10 - How to dynamic our scraper
#Webscraping #Paidprojects #Freelancing #Python #automation