AI Agent Chatbot with Jina.ai Web Scraper n8n Workflow Automation

Turn any URL into real-time answers with an AI Agent Chatbot + Jina.ai Web Scraper in n8n

This n8n workflow lets your chatbot scrape live webpage content on demand—so users can ask questions and receive responses based on up-to-date information retrieved directly from a provided URL. Built with a LangChain-based AI agent, it combines conversational context with web scraping to automate “find it, read it, answer it” tasks.

What this workflow does

• Triggers on chat input: Starts with “When chat message received” to capture the user’s question.
• Uses a Jina.ai Web Scraping Agent: The “Jina.ai Web Scraping Agent” interprets what information is needed to answer the query.
• Scrapes real-time webpage data: Employs the “HTTP Request” node to retrieve and process content from a user-provided URL.
• Keeps conversation context: Uses Window Buffer Memory to store and manage chat history for coherent follow-ups.
• Generates the final response: Sends the scraped content to the gpt-4o-mini language model to produce clear, contextually relevant answers.

Use cases

• Customer support research: Ask a question about a specific product page URL and get an AI-generated summary/answer based on that current page.
• Competitive and pricing checks: Provide competitor or pricing-page URLs to retrieve fresh details without manual browsing.
• Ops and documentation Q&A: Turn internal or public documentation URLs into chat-based “ask and retrieve” answers.
• Sales enablement: Answer prospects’ questions by scraping relevant webpage sections in real time.

Technical details

• n8n nodes: n8nn8n-nodes-langchainchat trigger (chat trigger), n8nn8n-nodes-langchainagent (Jina.ai Web Scraping Agent), n8nn8n-nodes-langchaintool http request (scraping via HTTP Request), n8nn8n-nodes-langchainmemory buffer window (Window Buffer Memory)
• Language model: gpt-4o-mini via n8nn8n-nodes-langchainlm chat open ai
• Includes a sticky note for workflow clarity