Scrape Google Search Results via Webhook with CoreClaw

Scrape Google search results on demand—just call a webhook

This n8n workflow exposes a webhook that takes a Google search query, runs the CoreClaw Google Search Scraper Worker via HTTP, and returns clean, structured JSON organic results (title, URL, snippet, and position). No manual scraping—send a POST request and get normalized results back.

What this workflow does

• Receives a POST request on the webhook endpoint with a search query plus optional parameters.
• Validates and formats the payload, applying defaults when needed: country = us, language = en, and max_results = 10.
• Calls CoreClaw by using the CoreClaw Google Search Scraper Worker API through an HTTP request, authenticated with the CORECLAW_API_KEY environment variable.
• Extracts and normalizes organic results from the CoreClaw response into a consistent array containing: position, title, url, displayed_url, and snippet.
• Returns a JSON webhook response that includes the original query context, result count, and the normalized results array.

Use cases

• SEO and competitive research automation: fetch current organic rankings for specific keywords.
• Lead and market intelligence: collect search results and feed them into your CRM or enrichment workflow.
• SaaS monitoring: periodically query keywords and track changes using an n8n scheduler plus this webhook.
• Content brief support: gather top organic snippets and sources for topic validation.

Technical details

• n8n nodes: Code, Webhook, Sticky Note, HTTP Request, Respond to Webhook.
• CoreClaw integration: HTTP call to the CoreClaw Google Search Scraper Worker API using CORECLAW_API_KEY from environment variables.
• Webhook endpoint: use the production webhook URL for the “google-search-scraper” endpoint.
• Request body: send { "query" } (or "q"/"keyword") plus optional country, language, and max_results.