Bulk Project URL Discovery in Google Sheets with Firecrawl (n8n)

Bulk discover project and portfolio URLs from a list of websites in Google Sheets—using Firecrawl Map inside n8n

This n8n workflow reads sites from your Google Sheet, runs Firecrawl Map to find relevant project/content links for each site, writes the mapped URLs back to Google Sheets, and marks each site as Done or Error. Run it manually anytime you need fresh URL discovery.

What this workflow does

• Manual trigger: Starts when you manually execute the workflow in n8n.
• Reads input from Google Sheets: Loads rows from the “Sites” sheet and processes only entries where the Status field is empty.
• Normalizes site data: Normalizes the site name and domain for downstream steps.
• Runs Firecrawl Map: Calls the Firecrawl Map API endpoint to crawl the site and return discovered links.
• Filters for likely project/portfolio pages: Filters the returned links to keep likely project/content URLs, then saves results to the “Mapped URLs” sheet.
• Writes status back to Google Sheets: Updates the original Sites row to Status = Done, or logs issues to “Mapped URLs” and sets Status = Error.
• Rate-friendly pacing: Waits 20 seconds between sites before continuing.

Use cases

• Bulk prospecting for agencies, studios, or creators by extracting portfolio/project URLs across many domains.
• Regularly refreshing a curated list of mapped URLs stored in Google Sheets.
• Automating “crawl → filter → write back” workflows for research and lead generation pipelines.

Technical details

• Google Sheets integration: Reads from “Sites” and writes to “Mapped URLs” (Name, Home Domain, Mapped URL, Error Message).
• Firecrawl Map API: Uses an HTTP Header Auth credential (Firecrawl API key) for the Firecrawl Map request.
• n8n nodes referenced in the workflow: Set, Code, No Op, Wait, Filter, and Sticky Note.

Setup tip: Ensure your spreadsheet has a “Sites” sheet with at least Name, Website, and Status, and a “Mapped URLs” sheet with the required columns.