PluginBench
MCP Server
Active
MIT

Ollama / vLLM Bridge MCP Server

io.github.setheerwagen/mcp-ollama-vllm

RepositoryRegistry
How to choose

What this kind of tool is for

  • Hand your agent a structured way to call a model or an inference API.
  • Compare outputs from two different providers on the same prompt.
  • Wire retrieval, embeddings, or generation into an existing agent workflow.

How to compare servers like this

Provider coverage:
Match the tool's supported providers and models to the ones your project uses.
Cost exposure:
Model-backed tools spend real API budget; check how usage and limits are configured.
Maintenance signal:
The provider landscape shifts weekly; prefer tools updated within the last few months.
Config surface:
Prefer tools whose environment-variable or config keys are documented plainly.

This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.

What is the Ollama / vLLM Bridge MCP server?

Call your local Ollama or vLLM model over MCP with schema-validated JSON output

How to install Ollama / vLLM Bridge

Copy-paste configuration for popular MCP clients.

transport: stdio
Config generated by PluginBench — verify against the source before use.
Environment / auth
  • LOCAL_BACKEND

    Backend to use: ollama, vllm or openai

  • LOCAL_HOST

    Model endpoint URL; must be local or on your own network. Required for the openai backend

  • LOCAL_API_KEY
    secret

    Optional bearer token, openai backend only; sent as a header, never logged

  • LOCAL_TIMEOUT

    Read timeout in seconds

  • LOCAL_EMBED_MODEL

    Default embedding model

  • LOCAL_EMBED_PATH

    Optional, openai backend only: embedding endpoint path

  • LOCAL_SCHEMA_MODE

    Optional, openai backend only: auto, response_format or none

~/Library/Application Support/Claude/claude_desktop_config.json
JSON config
{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm"
      ],
      "env": {
        "LOCAL_BACKEND": "<YOUR_LOCAL_BACKEND>",
        "LOCAL_HOST": "<YOUR_LOCAL_HOST>",
        "LOCAL_API_KEY": "<YOUR_LOCAL_API_KEY>",
        "LOCAL_TIMEOUT": "<YOUR_LOCAL_TIMEOUT>",
        "LOCAL_EMBED_MODEL": "<YOUR_LOCAL_EMBED_MODEL>",
        "LOCAL_EMBED_PATH": "<YOUR_LOCAL_EMBED_PATH>",
        "LOCAL_SCHEMA_MODE": "<YOUR_LOCAL_SCHEMA_MODE>"
      }
    }
  }
}

Related MCP servers

Manage your local model machine over MCP: state, model pull/remove, service switch, LoRA training

0
Python
MIT
View repository →

Local-first RAG MCP server: hybrid search over a folder of your own documents

2
Python
MIT
View repository →

Access 100+ curated AI agent skills from Anthropic, Vercel, Trail of Bits, Hugging Face & more

24
TypeScript
MIT
View repository →

Agent-first data marketplace — AI agents search, purchase, and sell datasets via MCP.

View repository →

Work your Luca workspace from any MCP client: 183 API tools + 15 task tools for leads and calls.

China state-owned enterprise campus recruitment: search jobs, deadlines, official source links.

0
MIT
View repository →