Update: Redfin has since added anti-scraping protections that invalidate the specific method I showed in this video. Instead, scrape it using a service like Firecrawl.dev, Apify, or Browserless. The HTTP request process I showed still works for the majority of static sites, so don't let that discourage you.
GET THE FREE MAKE.COM BLUEPRINT ?
https://leftclicker.gumroad.com/l/zcolpr
JOIN MY AUTOMATION COMMUNITY & GET YOUR FIRST CUSTOMER, GUARANTEED ?
https://www.skool.com/makerschool/about
SUMMARY ⤵️
In this video, I'll show you how to scrape any website using Make.com and AI!
First, I'll demonstrate how to gather data from virtually any source and transform it into structured information that you can use for various purposes using AI. You can customize outbound emails, build simple parasite SEO campaigns, etc in minutes.
Then, I'll show you how to scrape a large multinational data source like Redfin. We'll build custom parsers, apply sneaky headers to avoid being detected and I'll show you how to dump the data to a Google Sheet for later usage!
MY SOFTWARE, TOOLS, & DEALS (some of these give me kickbacks—thank you!)
? INSTANTLY: https://link.nicksaraev.com/instantly-short
? ANYMAIL FINDER: https://link.nicksaraev.com/amf-short
? PHANTOMBUSTER: https://link.nicksaraev.com/pb-short
✅ CLICKUP: https://link.nicksaraev.com/clickup-short
? RIZE: https://link.nicksaraev.com/rize-short (use promo code NICK for addn 25% off)
WHAT TO WATCH NEXT ?
HOW I HIT $25K/MO SELLING AUTOMATION: https://youtube.com/watch?v=T7qAiuWDwLw
MY $21K/MO MAKE.COM PROPOSAL SYSTEM: https://youtube.com/watch?v=UVLeX600irk
GENERATE CONTENT AUTOMATICALLY WITH AI: https://youtube.com/watch?v=P2Y_DVW1TSQ
FOLLOW ME
✍? My content writing agency: https://1secondcopy.com
? My automation agency: https://leftclick.ai
?️ My Twitter/X: https://twitter.com/nicksaraev
? My blog (followed by the founder of HubSpot!): https://nicksaraev.com
WHY ME?
If this is your first watch—hi, I’m Nick! TLDR: I spent five years building automated businesses with Make.com (most notably 1SecondCopy, a content company that hit 7 figures). Today a lot of people talk about automation, but I’ve noticed that very few have practical, real world success making money with it. So this channel is me chiming in and showing you what *real* systems that make *real* revenue look like!
Hopefully I can help you improve your business, and in doing so, the rest of your life :-)
Please like, subscribe, and leave me a comment if you have a specific request! Thanks.
Timestamps
00:00 Introduction
01:19 What we'll be covering
03:21 Scraping a website with the HTTP module
07:03 Text processing & turning HTML into plaintext for AI
08:37 Using AI to summarize a scraped website
13:37 Building a Google Sheets integration
16:08 Scraping a structured data source (Redfin)
23:13 Using Regex to parse Redfin
34:17 Advanced Make.com scraping—two HTTP calls in one
37:15 Using cookies in request headers
46:27 Parsing & splitting HTTP call results
55:05 Testing Google Sheets integration on real data
1:07:40 Final test of Redfin flow from end to end