Etsy Web Scraper
Scrapes Etsy listings via Bright Data with AI-based structured data extraction.
Overview
Scrapes Etsy product listings at scale using Bright Data's Web Unlocker to bypass restrictions, with AI-based extraction structuring the raw HTML into clean product data. It handles pagination, loops through every page, and delivers results as JSON plus webhook notifications.
What we built
- Bright Data Web Unlocker proxy (CAPTCHA bypass)
- AI identifies and follows all pagination links
- Loops through pages extracting product data
- Structures name, image, brand, price and URL into JSON
- Writes per-page JSON files
- Webhook notifications for monitoring
Tech
n8nBright DataGoogle GeminiGPT-4o-mini