PluginBench
MCP Server
Maintained
MIT

io.github.tjacquesson/llmtest-mcp MCP Server

io.github.tjacquesson/llmtest-mcp

RepositoryRegistry
How to choose

What this kind of tool is for

  • Hand your agent a structured way to call a model or an inference API.
  • Compare outputs from two different providers on the same prompt.
  • Wire retrieval, embeddings, or generation into an existing agent workflow.

How to compare servers like this

Provider coverage:
Match the tool's supported providers and models to the ones your project uses.
Cost exposure:
Model-backed tools spend real API budget; check how usage and limits are configured.
Maintenance signal:
The provider landscape shifts weekly; prefer tools updated within the last few months.
Config surface:
Prefer tools whose environment-variable or config keys are documented plainly.

This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.

What is the io.github.tjacquesson/llmtest-mcp MCP server?

Benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.

How to install io.github.tjacquesson/llmtest-mcp

Copy-paste configuration for popular MCP clients.

transport: stdio
Config generated by PluginBench — verify against the source before use.
Environment / auth
  • LLMTEST_API_KEY
    required
    secret

    Your LLMTest API key from https://llmtest.io/dashboard

~/Library/Application Support/Claude/claude_desktop_config.json
JSON config
{
  "mcpServers": {
    "llmtest-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "llmtest-mcp"
      ],
      "env": {
        "LLMTEST_API_KEY": "<YOUR_LLMTEST_API_KEY>"
      }
    }
  }
}

Related MCP servers

Four tools to check, watch, diagnose and verify AI agents and MCP servers. Free, read-only.

0
Python
MIT
View repository →

Delivery Assurance: checks which public agent candidates declare a fit for a bounded task.

0
Python
MIT
View repository →

Track and optimize AI API spending across 16 providers with live pricing.

0
Python
View repository →

Auto-classifies prompt complexity and routes to the right Claude thinking mode. No API key needed.

3
TypeScript
MIT
View repository →

Provenance showcase: compares public evidence for rights-clear art collections, flags conflicts.

0
Python
MIT
View repository →

Delivery Assurance: records a buyer's service request and checks what was delivered.

0
Python
MIT
View repository →