{"product_id":"recursive-web-scraper-n8n-workflow-with-airtop-google-sheets","title":"Recursive Web Scraper n8n Workflow with Airtop \u0026 Google Sheets","description":"\u003ch3\u003eRecursively scrape websites from a URL list—store page content, discover new links, and iterate automatically with n8n\u003c\/h3\u003e\n\u003cp\u003eThis \u003cstrong\u003eRecursive Web Scraper n8n workflow with Airtop \u0026amp; Google Sheets\u003c\/strong\u003e reads a starting URL from Google Sheets, scrapes each page, saves the results to a document, then extracts matching links from the scraped pages and appends them back to the sheet—repeating for your configured \u003cstrong\u003eDepth\u003c\/strong\u003e.\u003c\/p\u003e\n\n\u003ch3\u003eWhat this workflow does\u003c\/h3\u003e\n\u003cp\u003eBuilt for recursive depth collection (content across multiple linked pages), the automation follows this flow:\u003c\/p\u003e\n\u003cul\u003e\n  \u003cli\u003e\n\u003cstrong\u003eSeed URL:\u003c\/strong\u003e Starts by reading the \u003cem\u003eSeed URL\u003c\/em\u003e from the Google Sheet.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eScrape and store:\u003c\/strong\u003e Scrapes each page and saves its \u003cstrong\u003econtent\u003c\/strong\u003e into the specified document (via Google Docs).\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eFilter discovered links:\u003c\/strong\u003e Extracts newly discovered links from each page that match the \u003cem\u003eLinks must contain\u003c\/em\u003e string.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eUpdate Google Sheet:\u003c\/strong\u003e Appends those newly found links back into the Google Sheet.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eIterate by depth:\u003c\/strong\u003e Repeats scraping and link discovery for \u003cstrong\u003eDepth - 1\u003c\/strong\u003e additional iterations (layers of links).\u003c\/li\u003e\n\u003c\/ul\u003e\n\n\u003ch3\u003eUse cases\u003c\/h3\u003e\n\u003cul\u003e\n  \u003cli\u003e\n\u003cstrong\u003eContent aggregation:\u003c\/strong\u003e Collect structured page content across a site section by limiting link discovery with a keyword or URL fragment.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eLead generation \u0026amp; research:\u003c\/strong\u003e Build a growing list of relevant pages by recursively following internal links that match your criteria.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eCompetitive research:\u003c\/strong\u003e Gather documentation or topic pages by specifying a “must contain” link pattern and scraping multiple layers deep.\u003c\/li\u003e\n\u003c\/ul\u003e\n\n\u003ch3\u003eTechnical details\u003c\/h3\u003e\n\u003cp\u003eDesigned for n8n users and automation engineers, this workflow uses:\u003c\/p\u003e\n\u003cul\u003e\n  \u003cli\u003e\n\u003cstrong\u003eGoogle Sheets\u003c\/strong\u003e (reads \u003cem\u003eSeed URL\u003c\/em\u003e and appends newly discovered links)\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eGoogle Docs\u003c\/strong\u003e (stores scraped page content; requires Google credentials)\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eAirtop\u003c\/strong\u003e (requires an \u003cstrong\u003eAirtop API Key\u003c\/strong\u003e)\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003en8n nodes:\u003c\/strong\u003e \u003ccode\u003eif\u003c\/code\u003e, \u003ccode\u003eset\u003c\/code\u003e, \u003ccode\u003ecode\u003c\/code\u003e, \u003cstrong\u003eairtop\u003c\/strong\u003e, \u003cstrong\u003egoogle docs\u003c\/strong\u003e, plus \u003cstrong\u003esticky note\u003c\/strong\u003e for workflow guidance\u003c\/li\u003e\n\u003c\/ul\u003e\n\u003cp\u003e\u003cstrong\u003eSetup requirements:\u003c\/strong\u003e Generate an \u003cstrong\u003eAirtop API Key\u003c\/strong\u003e, configure Google Docs credentials in Google Console, and set your \u003cem\u003eSeed URL\u003c\/em\u003e, \u003cem\u003eLinks must contain\u003c\/em\u003e, and `Depth` in the Google Sheet.\u003c\/p\u003e","brand":"N8N Commerce","offers":[{"title":"Default Title","offer_id":45748949942451,"sku":"N8N-4252","price":47.99,"currency_code":"GBP","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0749\/6279\/6723\/files\/t-iP-7lQwyADPcGyDIusR_g6kB1B0N.png?v=1785576198","url":"https:\/\/buyflowscripts.com\/products\/recursive-web-scraper-n8n-workflow-with-airtop-google-sheets","provider":"N8N Commerce","version":"1.0","type":"link"}