AI Support Agent Regression Testing in n8n: Google Sheets, Groq & Gmail

Regression-test your customer-support AI in n8n—using Google Sheets, Groq, and Gmail

This n8n workflow runs an AI support agent against your Google Sheets test cases, scores the quality with Groq-hosted LLMs, logs everything back to Sheets, and automatically sends Gmail alerts when results regress or need QA review.

What this workflow does

• Manual start: Designed to begin when you manually execute the workflow in n8n.
• Loads test scenarios: Reads rows from a Google Sheets “Test_Cases” tab, filters to Active scenarios, and processes them in batches.
• Generates support answers: For each test case, it constructs a customer-support prompt and generates an agent response using Google Gemini.
• Evaluates response quality with Groq: Sends the question, Expected_Facts, Expected_Outcome, and the agent response to a Groq LLM that returns scoring as JSON—covering relevance, reference accuracy, completeness, instruction compliance, and hallucination risk.
• Logs per-test results: Parses the evaluator JSON and appends detailed results (including the agent response and overall result) to an Evaluation_Results sheet.
• Compares against a baseline: Aggregates the current run, selects the latest previously reviewed baseline from Google Sheets, and computes pass-rate regression and metric deltas.
• Routes outcomes to QA via Gmail: Writes run-level metrics back to Google Sheets, then marks success or sends Gmail warning/alert messages to the QA team.

Use cases

• Catch customer-support regressions after prompt/model changes in your AI agent.
• Continuously monitor answer quality across a curated set of scenarios maintained in Google Sheets.
• Automate QA review workflows by alerting the team when baseline comparisons fail.

Technical details

• Integrations: Google Sheets (Test_Cases, Evaluation_Results, Baseline_Metrics) and Gmail.
• LLMs: Google Gemini for agent responses; Groq LLM for JSON evaluation scoring.
• n8n nodes/logic: if, filter, switch, set, code, and gmail for control flow and reporting.