Skip to main content
You want to know which model is best for your prompt — not a leaderboard, your actual task. Your agent sends the same prompt to five models in parallel, then has Claude judge them blind on accuracy, completeness, and tone. ~$0.14, one wallet — no juggling five provider accounts.
This is a durable gateway demo — the headline is one wallet replacing five API keys. A sandboxed client can’t reach five real frontier models at once; here it’s one pay per model, gasless, no signup.

The prompt


What runs

  1. POST /anthropic/v1/messages — Claude’s answer (~$0.02)
  2. POST /openai/v1/chat/completions — GPT’s answer (~$0.02)
  3. POST /gemini/v1beta/models/gemini-2.5-pro — Gemini’s answer (~$0.04)
  4. POST /groq/v1/chat/completions — Llama (on Groq) answer (~$0.02)
  5. POST /deepseek/v1/chat/completions — DeepSeek’s answer (~$0.02)
  6. POST /anthropic/v1/messages — Claude judges all five (~$0.02)

Run it

Claude Desktop (MCP)

Paste the prompt with any task. The agent fans out to all five, then scores them.

SDK


Expected output


Extend it

  • Add Mistral (/mistral/v1/chat/completions) or Cohere (/cohere/v1/chat) to widen the field
  • Swap Gemini 2.5 Pro for Flash (/gemini/v1beta/models/gemini-2.5-flash) to bake off on cost too
  • Time each call to compare latency, not just quality — Groq usually wins that one
  • Render the scorecard to a PDF with PDFShift (/pdfshift/v1/convert) for a shareable eval