What this kind of tool is for
- Hand your agent a structured way to call a model or an inference API.
- Compare outputs from two different providers on the same prompt.
- Wire retrieval, embeddings, or generation into an existing agent workflow.
How to compare servers like this
- Provider coverage:
- Match the tool's supported providers and models to the ones your project uses.
- Cost exposure:
- Model-backed tools spend real API budget; check how usage and limits are configured.
- Maintenance signal:
- The provider landscape shifts weekly; prefer tools updated within the last few months.
- Config surface:
- Prefer tools whose environment-variable or config keys are documented plainly.
This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.
What is the CompletionKit MCP server?
Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.
How to install CompletionKit
Copy-paste configuration for popular MCP clients.
AuthorizationrequiredsecretYour CompletionKit API token as: Bearer <token>. Create one under Settings > API tokens.
{
"mcpServers": {
"evals": {
"url": "https://completionkit.com/mcp"
}
}
}Related MCP servers
GPU and LLM inference benchmarks, hardware evidence, deployment recommendations, and launch configs.
Unified dispute resolution: crypto, payments, SLA violations. 95% AI automation.

com.covasyn/chemistry
Deterministic MCP for AI agents: drug discovery, ADMET, docking, LNPs, DoE, retrosynthesis, ICH M7

CPZAI
Build, backtest, and deploy quantitative trading strategies from your AI agent.
Public read-only MCP for products, frameworks, guides, methodology, and blog metadata.
OFAC and global sanctions screening: crypto addresses, emails, websites, IDs, countries, VPN, geo