Find Competitor Content Gaps with Bright Data, GPT-5.6 & Slack

Find competitor SEO content gaps fast—powered by Bright Data, GPT-5.6, and Slack

This n8n automation compares your site against a competitor by crawling their sitemap trees, spotting topic words from competitor URL slugs that never appear on yours, and then using GPT-5.6 to rank which gaps are worth covering—delivered to Google Sheets, a Slack channel, and your form completion page.

What this workflow does

• Receives a form submission with your domain and a competitor domain.
• Fetches robots.txt and sitemap URLs for both domains using Bright Data Web Unlocker, then extracts declared sitemap URLs (or falls back to common sitemap paths) and validates that the responses are real XML.
• Crawls sitemap indexes recursively to collect page URLs, skipping non-content and localized sitemap branches, while stopping at the configured depth and per-site limits.
• Identifies content gap “topic words” by tokenizing URL slugs into topic words, ranking words that appear across many competitor URLs but none of yours.
• Generates gap research by fetching a limited number of example competitor articles for the top gaps via Bright Data, extracting each article’s title and opening text.
• Rates and summarizes gaps with GPT-5.6, compiling each gap’s angle and whether it’s worth covering.
• Delivers results by appending one row per rated gap to Google Sheets, posting a formatted summary to Slack, and rendering an HTML table on the form completion page.

Use cases

• SEO teams using n8n to produce content gap analysis after receiving domain pair submissions from a web form.
• SaaS operators running ongoing competitor research workflows to generate publishing priorities.
• Automation engineers setting up a repeatable pipeline for competitor sitemap crawling, gap extraction, and reporting.

Technical details

• Bright Data Web Unlocker: robots.txt + sitemap XML retrieval with HTTP Header Auth (zone + zone name in workflow settings).
• OpenAI GPT-5.6: summarizes gap angles and rates worthiness to cover.
• Google Sheets: appends one row per rated gap.
• Slack: posts formatted gap summaries to a channel.
• n8n nodes used: if, set, code, form, slack, split out.