PluginBench
MCP Server
Active

CompletionKit MCP Server

com.completionkit/evals

RepositoryRegistry
How to choose

What this kind of tool is for

  • Hand your agent a structured way to call a model or an inference API.
  • Compare outputs from two different providers on the same prompt.
  • Wire retrieval, embeddings, or generation into an existing agent workflow.

How to compare servers like this

Provider coverage:
Match the tool's supported providers and models to the ones your project uses.
Cost exposure:
Model-backed tools spend real API budget; check how usage and limits are configured.
Maintenance signal:
The provider landscape shifts weekly; prefer tools updated within the last few months.
Config surface:
Prefer tools whose environment-variable or config keys are documented plainly.

This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.

What is the CompletionKit MCP server?

Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.

How to install CompletionKit

Copy-paste configuration for popular MCP clients.

transport: http
Config generated by PluginBench — verify against the source before use.
Environment / auth
  • Authorization
    required
    secret

    Your CompletionKit API token as: Bearer <token>. Create one under Settings > API tokens.

~/.cursor/mcp.json
JSON config
{
  "mcpServers": {
    "evals": {
      "url": "https://completionkit.com/mcp"
    }
  }
}

Related MCP servers

GPU and LLM inference benchmarks, hardware evidence, deployment recommendations, and launch configs.

Unified dispute resolution: crypto, payments, SLA violations. 95% AI automation.

Deterministic MCP for AI agents: drug discovery, ADMET, docking, LNPs, DoE, retrosynthesis, ICH M7

0
JavaScript
MIT
View repository →
CPCPZAI logo

CPZAI

Active

Build, backtest, and deploy quantitative trading strategies from your AI agent.

1
TypeScript
MIT
View repository →

Public read-only MCP for products, frameworks, guides, methodology, and blog metadata.

OFAC and global sanctions screening: crypto addresses, emails, websites, IDs, countries, VPN, geo