Compare AI Models Instantly with Multi-LLM Tool & Google Sheets

Stop guessing which AI model works best for your prompts. This powerful n8n workflow automatically tests your prompts across 3 different AI models simultaneously, comparing speed, cost, and quality metrics in real-time. Every comparison is automatically logged to Google Sheets with detailed performance data and winner badges.

What this workflow does

This multi-LLM comparison tool streamlines AI model testing by running your actual prompts through OpenAI GPT, Meta Llama, and Llama 3.1 models in parallel. Simply configure your Groq API key in the settings node, add your custom prompts to the prompts list (5 included by default), and click run. The workflow intelligently handles rate limiting with smart retry-on-429 functionality and processes batches efficiently using split-in-batches nodes.

Each prompt generates 30 responses across all models, automatically calculating tokens-per-second, response quality scores, and cost metrics. Results are instantly saved to Google Sheets with visual badges highlighting the winning model for each category.

Use cases

• Prompt engineering optimization - Test multiple prompt variations to find the most effective wording across different AI models
• AI cost optimization - Compare token usage and pricing across models to minimize operational costs
• Model selection for production - Make data-driven decisions when choosing LLMs for your applications
• Performance benchmarking - Evaluate response speed and quality metrics for specific use cases
• A/B testing AI responses - Compare model outputs side-by-side for content generation projects

Technical details

Built with essential n8n nodes including manual trigger for easy execution, set nodes for configuration management, code nodes for API integration with Groq's free AI models, merge nodes for combining results, split-in-batches for efficient processing, and Google Sheets integration for automated data logging. The workflow includes unique run IDs for tracking and supports unlimited custom prompts for comprehensive AI model comparison testing.