PluginBench
MCP Server
Active
MIT

Ollama / vLLM Bridge MCP Server

io.github.setheerwagen/mcp-ollama-vllm

What is the Ollama / vLLM Bridge MCP server?

Call your local Ollama or vLLM model over MCP with schema-validated JSON output

How to install Ollama / vLLM Bridge

Copy-paste configuration for popular MCP clients.

transport: stdio
Config generated by PluginBench — verify against the source before use.
Environment / auth
  • LOCAL_BACKEND

    Backend to use: ollama, vllm or openai

  • LOCAL_HOST

    Model endpoint URL; must be local or on your own network. Required for the openai backend

  • LOCAL_API_KEY
    secret

    Optional bearer token, openai backend only; sent as a header, never logged

  • LOCAL_TIMEOUT

    Read timeout in seconds

  • LOCAL_EMBED_MODEL

    Default embedding model

  • LOCAL_EMBED_PATH

    Optional, openai backend only: embedding endpoint path

  • LOCAL_SCHEMA_MODE

    Optional, openai backend only: auto, response_format or none

~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm"
      ],
      "env": {
        "LOCAL_BACKEND": "<YOUR_LOCAL_BACKEND>",
        "LOCAL_HOST": "<YOUR_LOCAL_HOST>",
        "LOCAL_API_KEY": "<YOUR_LOCAL_API_KEY>",
        "LOCAL_TIMEOUT": "<YOUR_LOCAL_TIMEOUT>",
        "LOCAL_EMBED_MODEL": "<YOUR_LOCAL_EMBED_MODEL>",
        "LOCAL_EMBED_PATH": "<YOUR_LOCAL_EMBED_PATH>",
        "LOCAL_SCHEMA_MODE": "<YOUR_LOCAL_SCHEMA_MODE>"
      }
    }
  }
}

Related MCP servers

Manage your local model machine over MCP: state, model pull/remove, service switch, LoRA training

0
Python
MIT
View repository →

Work your Luca workspace from any MCP client: 183 API tools + 15 task tools for leads and calls.

China state-owned enterprise campus recruitment: search jobs, deadlines, official source links.

0
MIT
View repository →
SESetSmart logo

SetSmart

Maintained

Instagram, WhatsApp and Messenger DMs through official Meta Business APIs.

0
JavaScript
MIT
View repository →
TITickscope logo

Tickscope

Maintained

Real-time, free crypto market data for any AI agent — via MCP.

1
Python
MIT
View repository →

Agent-native notes, tasks, dev-docs, vaults, sync & handoffs. MCP + OpenAPI dual surface.

View repository →