io.github.RudrenduPaul/inferbench MCP Server
io.github.RudrenduPaul/inferbench
What this kind of tool is for
- Hand your agent a structured way to call a model or an inference API.
- Compare outputs from two different providers on the same prompt.
- Wire retrieval, embeddings, or generation into an existing agent workflow.
How to compare servers like this
- Provider coverage:
- Match the tool's supported providers and models to the ones your project uses.
- Cost exposure:
- Model-backed tools spend real API budget; check how usage and limits are configured.
- Maintenance signal:
- The provider landscape shifts weekly; prefer tools updated within the last few months.
- Config surface:
- Prefer tools whose environment-variable or config keys are documented plainly.
This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.
What is the io.github.RudrenduPaul/inferbench MCP server?
Benchmarks local LLM inference speed (tokens/sec) on your own hardware via MCP tools.
How to install io.github.RudrenduPaul/inferbench
Copy-paste configuration for popular MCP clients.
{
"mcpServers": {
"inferbench": {
"command": "uvx",
"args": [
"inferbench-cli",
"--from",
"inferbench-cli",
"inferbench-mcp"
]
}
}
}Related MCP servers

Zero-config SEO and GEO checker: 21 technical-SEO and generative-engine checks for a live site.
Wraps the MasteryTrace CLI as a single generic MCP tool for skill-mastery tracking.

Independent, reproducible benchmark harness for agent-memory backends.
Traces which neurons and attention heads drive a language model's output via MCP tools.

Wraps the ownvoice CLI as a single generic MCP tool for voice/identity checks.

Verifies Ed25519-signed attestation records and builds audit reports via MCP tools.