{"product_id":"apify-website-crawler-qdrant-sync-with-openai-embeddings-n8n","title":"Apify Website Crawler → Qdrant Sync with OpenAI Embeddings (n8n)","description":"\u003ch3\u003eKeep your Qdrant knowledge base fresh—automatically sync Apify crawls with OpenAI embeddings in n8n\u003c\/h3\u003e\n\u003cp\u003eThis n8n workflow triggers when an \u003cstrong\u003eApify Website Content Crawler\u003c\/strong\u003e run finishes, then syncs the crawl dataset into your \u003cstrong\u003eQdrant\u003c\/strong\u003e collection using \u003cstrong\u003eOpenAI embeddings\u003c\/strong\u003e. It also produces a freshness report showing vectors before\/after and which chunks were added, refreshed, or deleted.\u003c\/p\u003e\n\n\u003ch3\u003eWhat this workflow does\u003c\/h3\u003e\n\u003cul\u003e\n  \u003cli\u003e\n\u003cstrong\u003eTriggers on completion:\u003c\/strong\u003e Starts when an \u003cem\u003eApify Website Content Crawler\u003c\/em\u003e actor run is completed.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eCaptures a baseline:\u003c\/strong\u003e Calls the \u003cstrong\u003eQdrant Collections API\u003c\/strong\u003e to read the current point count in the target collection (vectors-before).\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003ePerforms the sync:\u003c\/strong\u003e Launches an \u003cstrong\u003eApify Qdrant Integration\u003c\/strong\u003e actor run to upsert the crawl dataset into Qdrant, generating \u003cstrong\u003eOpenAI embeddings\u003c\/strong\u003e and applying \u003cstrong\u003edelta updates\u003c\/strong\u003e plus deletion of expired chunks.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eWaits for settling:\u003c\/strong\u003e Pauses for \u003cstrong\u003e30 seconds\u003c\/strong\u003e to allow the Qdrant sync to settle.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eVerifies the result:\u003c\/strong\u003e Calls the \u003cstrong\u003eQdrant Collections API\u003c\/strong\u003e again to read the post-sync point count (vectors-after).\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eReports freshness:\u003c\/strong\u003e Fetches the Apify actor run logs and outputs a report with vectors-before\/after and counts of \u003cstrong\u003echunks added\u003c\/strong\u003e, \u003cstrong\u003erefreshed\u003c\/strong\u003e, and \u003cstrong\u003edeleted\u003c\/strong\u003e.\u003c\/li\u003e\n\u003c\/ul\u003e\n\n\u003ch3\u003eUse cases\u003c\/h3\u003e\n\u003cul\u003e\n  \u003cli\u003e\n\u003cstrong\u003eSaaS operators\u003c\/strong\u003e maintaining an up-to-date semantic search or RAG index from a website.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eAutomation engineers\u003c\/strong\u003e who want automated vector delta updates (including deletion of expired chunks) after crawling.\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eTeams using Qdrant + OpenAI embeddings\u003c\/strong\u003e that need visibility into indexing changes after every crawl.\u003c\/li\u003e\n\u003c\/ul\u003e\n\n\u003ch3\u003eTechnical details\u003c\/h3\u003e\n\u003cul\u003e\n  \u003cli\u003e\n\u003cstrong\u003en8n nodes \/ tools:\u003c\/strong\u003e Code, Wait, Sticky Note, HTTP Request, \u003ccode\u003eapify\/n8n-nodes-apify\u003c\/code\u003e (Apify Trigger + Apify runs)\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eExternal APIs:\u003c\/strong\u003e Qdrant Collections API (point count reads) and Apify actor run logs\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eEnvironment variables:\u003c\/strong\u003e \u003ccode\u003eQDRANT_API_KEY\u003c\/code\u003e and \u003ccode\u003eOPENAI_API_KEY\u003c\/code\u003e (ensure env access is enabled in nodes if required)\u003c\/li\u003e\n  \u003cli\u003e\n\u003cstrong\u003eSetup requirement:\u003c\/strong\u003e Replace \u003ccode\u003ehttps:\/\/YOUR-CLUSTER.qdrant.io:6333\u003c\/code\u003e with your Qdrant endpoint and ensure the target collection name (e.g., \u003ccode\u003edocs\u003c\/code\u003e) is correct or allowed to auto-create.\u003c\/li\u003e\n\u003c\/ul\u003e","brand":"N8N Commerce","offers":[{"title":"Default Title","offer_id":46086651674803,"sku":"N8N-19911","price":8.99,"currency_code":"GBP","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0749\/6279\/6723\/files\/fjWe6j3HfCjcw3_6y8Fi4_khpqo0XO.png?v=1790327260","url":"https:\/\/buyflowscripts.com\/products\/apify-website-crawler-qdrant-sync-with-openai-embeddings-n8n","provider":"N8N Commerce","version":"1.0","type":"link"}