PluginBench
MCP Server
Active

io.github.bch1212/modelwatch MCP Server

io.github.bch1212/modelwatch

RepositoryRegistry
How to choose

What this kind of tool is for

  • Hand your agent a structured way to call a model or an inference API.
  • Compare outputs from two different providers on the same prompt.
  • Wire retrieval, embeddings, or generation into an existing agent workflow.

How to compare servers like this

Provider coverage:
Match the tool's supported providers and models to the ones your project uses.
Cost exposure:
Model-backed tools spend real API budget; check how usage and limits are configured.
Maintenance signal:
The provider landscape shifts weekly; prefer tools updated within the last few months.
Config surface:
Prefer tools whose environment-variable or config keys are documented plainly.

This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.

What is the io.github.bch1212/modelwatch MCP server?

Continuous behavioral drift monitoring for LLM apps — catches silent provider model updates.

How to install io.github.bch1212/modelwatch

Copy-paste configuration for popular MCP clients.

transport: stdio
Config generated by PluginBench — verify against the source before use.
Environment / auth
  • MODELWATCH_API_KEY
    required
    secret

    API key from https://modelwatch.app (free tier: 5 specs, 500 runs/mo).

  • MODELWATCH_API_BASE

    Override the API base URL for self-hosted deployments.

~/Library/Application Support/Claude/claude_desktop_config.json
JSON config
{
  "mcpServers": {
    "modelwatch": {
      "command": "npx",
      "args": [
        "-y",
        "modelwatch-mcp"
      ],
      "env": {
        "MODELWATCH_API_KEY": "<YOUR_MODELWATCH_API_KEY>",
        "MODELWATCH_API_BASE": "<YOUR_MODELWATCH_API_BASE>"
      }
    }
  }
}

Related MCP servers

Paid MCP for fishing/lake/stocking intelligence — 72k+ US lakes, 293k+ events.

0
Python
MIT
View repository →

US public-records intelligence for AI agents — companies, SEC, courts, spending, licenses.

0
Python
MIT
View repository →

Secure SQL proxy for AI agents — NL→SQL, AST safety, per-agent RLS, audit log.

1
Python
MIT
View repository →

Agent Commerce MCP — agent-native A2A storefront. Discovery, Stripe checkout, affiliate program.

0
TypeScript
MIT
View repository →
AEAESO MCP logo

AESO MCP

Active

Typed Alberta electricity market data and analytics via official AESO APIs.

0
Python
MIT
View repository →

Record how your macOS Dock evolves and render Apple-style timelapse videos of it.

0
Python
MIT
View repository →