SEO Knowledge Graph Crawler: n8n, Claude, Postgres & Slack

Build an SEO Knowledge Graph Automatically—From Sitemap to Postgres to Slack

This n8n workflow crawls your website from sitemap.xml, extracts on-page content and links, uses Anthropic Claude to identify keywords and entities, stores everything as an SEO knowledge graph in Postgres, and sends crawl health stats to Slack.

What this workflow does

• Starts a crawl manually or on a weekly schedule using your configured seed URL, sitemap URL, page limit, and Slack channel.
• Fetches and processes sitemap.xml, parsing and deduplicating page URLs (optionally limiting to same-domain URLs), then batching requests up to the maximum page count.
• Crawls each page and extracts: title, meta description, H1s, body text, and outbound links.
• Analyzes content with Anthropic Claude to return structured JSON containing primary/secondary keywords, named entities, and topic categories.
• Persists the SEO graph in Postgres by writing page nodes plus relationships into tables such as: seo_pages, seo_keywords, seo_entities, seo_page_keywords, seo_page_entities, and seo_page_links.
• Summarizes crawl “digital-twin” stats (pages, unique keywords, entities, internal links, orphan pages) and posts the results to Slack.

Use cases

• SaaS SEO operators tracking how pages, keywords, entities, and internal linking evolve over time.
• Automation engineers building an SEO knowledge graph for dashboards and content strategy.
• Teams monitoring crawl health by reviewing Slack updates after scheduled sitemap crawls.

Technical details

• Integrations/Nodes: set, code, html, merge, slack, postgres.
• AI extraction: Anthropic Claude returns structured JSON for keywords, entities, and topic categories.
• Database: requires creating Postgres tables and constraints for the SEO graph, including ON CONFLICT behavior used by the workflow queries.

Perfect if you’re looking for a practical SEO knowledge graph crawler that turns sitemap data into a queryable structure in Postgres and keeps stakeholders informed via Slack.