Join Maker School & get your first automation customer ⤵️
https://www.skool.com/makerschool/about
Summary ⤵️
Here I show you the 9 best ways to scrape websites using N8N.
First, I'll cover the basics of handling static and dynamic sites (and the differences between them. I'll then show you how to manage direct HTTP requests in N8N before demoing tools like Firecrawl, RapidAPI, and Browserless. Plus, I'll explore options like the Web Scraper Chrome Extension and Apify for advanced tasks. Let me know if q's!
The Five, my pod w Matt Larsen on how to run a $10M/yr business ⤵️
https://www.youtube.com/watch?v=LKOe8GLLEIo
My software, tools, & deals (some give me kickbacks—thank you!)
🚀 Instantly: https://link.nicksaraev.com/instantly-short
📧 Anymailfinder: https://link.nicksaraev.com/amf-short
🤖 Apify: https://console.apify.com/sign-up (30% off with code 30NICKSARAEV)
🧑🏽💻 n8n: https://n8n.partnerlinks.io/h372ujv8cw80
📈 Rize: https://link.nicksaraev.com/rize-short (25% off with promo code NICK)
Follow me on other platforms 😈
📸 Instagram: https://www.instagram.com/nick_saraev
🕊️ Twitter/X: https://twitter.com/nicksaraev
🤙 Blog: https://nicksaraev.com
Why watch?
If this is your first view—hi, I’m Nick! TLDR: I spent six years building automated businesses with Make.com (most notably 1SecondCopy, a content company that hit 7 figures). Today a lot of people talk about automation, but I’ve noticed that very few have practical, real world success making money with it. So this channel is me chiming in and showing you what *real* systems that make *real* revenue look like.
Hopefully I can help you improve your business, and in doing so, the rest of your life 🙏
Like, subscribe, and leave me a comment if you have a specific request! Thanks.
Chapters
00:00:00 Introduction to Web Scraping in N8N
00:00:42 Understanding Static vs Dynamic Sites
00:02:44 First Method: HTTP Requests
00:05:44 Converting HTML to Markdown
00:09:51 Using OpenAI for Data Processing
00:10:17 Second Method: Firecrawl Service
00:11:25 Signing Up for Firecrawl
00:14:10 Third Method: Rapid API Marketplace
00:19:24 Fourth Method: Web Scraper Chrome Extension
00:25:36 Fifth Method: Appify for Scraping
00:34:30 Sixth Method: Data for SEO API
00:41:18 Seventh Method: Crawlbase for High Volume Requests
00:48:51 Eighth Method: Octoparse for Local Scraping
01:03:30 Ninth Method: Browserless for Dynamic Sites
01:08:20 Conclusion and Future Content Suggestions