PluginBench
MCP Server
Active
Apache-2.0

ai.smithery/pinkpixel-dev-web-scout-mcp MCP Server

ai.smithery/pinkpixel-dev-web-scout-mcp

Search the web with DuckDuckGo and extract clean text from multiple URLs simultaneously.

What is the ai.smithery/pinkpixel-dev-web-scout-mcp MCP server?

The Web Scout MCP server enables AI agents to search the web using DuckDuckGo and extract clean, readable content from webpages. It supports parallel processing of multiple URLs with built-in rate limiting and memory optimization to prevent crashes.

Web Scout provides two core capabilities: privacy-focused web search via DuckDuckGo and intelligent content extraction that strips away scripts, styles, and navigation to deliver readable text. Use it to research topics, gather information from multiple sources at once, or feed webpage content into AI analysis workflows.

How to install ai.smithery/pinkpixel-dev-web-scout-mcp

Copy-paste configuration for popular MCP clients.

transport: http
Config generated by PluginBench — verify against the source before use.
Environment / auth
  • Authorization
    required
    secret

    Bearer token for Smithery authentication

~/.cursor/mcp.json
{
  "mcpServers": {
    "pinkpixel-dev-web-scout-mcp": {
      "url": "https://server.smithery.ai/@pinkpixel-dev/web-scout-mcp/mcp"
    }
  }
}

Tools & capabilities

Tools this server exposes to the agent.

  • DuckDuckGoWebSearch — Initiates a web search query using DuckDuckGo and returns a structured list of results with titles, URLs, and snippets. Accepts a search query string and optional maxResults parameter (default: 10).
  • UrlContentExtractor — Fetches and extracts clean, readable content from web pages by removing scripts, styles, and navigation elements. Accepts either a single URL string or an array of URL strings for parallel processing.

Use cases

  • Research topics by searching the web and extracting full article text from multiple sources
  • Gather competitive intelligence by fetching and analyzing content from competitor websites
  • Fact-check claims by searching for relevant information and extracting source material
  • Build knowledge bases by bulk-extracting content from multiple URLs simultaneously
  • Monitor web content by periodically searching for and extracting updates on specific topics

ai.smithery/pinkpixel-dev-web-scout-mcp MCP server FAQ

What is the Web Scout MCP server?

Web Scout is an MCP server that combines DuckDuckGo web search with intelligent content extraction. It lets AI agents search the web and pull clean, readable text from webpages, with support for processing multiple URLs in parallel.

Is Web Scout free to use?

Yes, Web Scout is open-source under the Apache 2.0 License and uses DuckDuckGo for search, which is free and privacy-focused.

How do I install Web Scout in Claude Desktop?

Run: npx -y @smithery/cli install @pinkpixel-dev/web-scout-mcp --client claude. Alternatively, add the server to your Claude Desktop config.json with the npx command.

Can I extract content from multiple URLs at once?

Yes, the UrlContentExtractor tool accepts either a single URL string or an array of URL strings and processes them in parallel with smart memory management.

What are the system requirements?

Node.js >= 18.0.0 and npm or yarn. The server runs as an MCP server and can be installed globally or locally via npm.

Does Web Scout require API keys or authentication?

No, Web Scout uses DuckDuckGo which does not require API keys, and webpage extraction works without authentication.

README (reference)

Source of truth, from the repository.

<p align="center"> <img src="assets/logo.png" alt="Web Scout MCP Logo" width="300"/> </p> <h1 align="center">Web Scout MCP Server</h1> <p align="center"> <a href="https://www.npmjs.com/package/@pinkpixel/web-scout-mcp"><img src="https://img.shields.io/npm/v/@pinkpixel/web-scout-mcp.svg" alt="npm version"></a> <a href="https://github.com/pinkpixel-dev/web-scout-mcp/blob/main/LICENSE"><img src="https://img.shields.io/badge/license-MIT-blue.svg" alt="License"></a> <a href="https://nodejs.org/en/"><img src="https://img.shields.io/badge/node-%3E%3D18.0.0-brightgreen.svg" alt="Node.js Version"></a> <a href="https://smithery.ai/servers/pinkpixel-dev/web-scout-mcp"><img alt="Smithery Badge" src="https://smithery.ai/badge/pinkpixel-dev/web-scout-mcp"></a> </p> <p align="center"> <a href="https://glama.ai/mcp/servers/pinkpixel-dev/web-scout-mcp"><img src="https://glama.ai/mcp/servers/pinkpixel-dev/web-scout-mcp/badges/score.svg" alt="web-scout-mcp MCP server" /></a> <a href="https://mseep.ai/app/pinkpixel-dev-web-scout-mcp"><img src="https://mseep.net/pr/pinkpixel-dev-web-scout-mcp-badge.png" alt="MseeP.ai Security Assessment Badge" width="200" /></a> </p> <p align="center"> An MCP server for web search using DuckDuckGo and content extraction, with support for multiple URLs and memory optimizations. </p>

✨ Features

  • 🔍 DuckDuckGo Search: Fast and privacy-focused web search capability
  • 📄 Content Extraction: Clean, readable text extraction from web pages
  • 🚀 Parallel Processing: Support for extracting content from multiple URLs simultaneously
  • 💾 Memory Optimization: Smart memory management to prevent application crashes
  • ⏱️ Rate Limiting: Intelligent request throttling to avoid API blocks
  • 🛡️ Error Handling: Robust error handling for reliable operation

📦 Installation

Installing via Smithery

To install Web Scout for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install @pinkpixel-dev/web-scout-mcp --client claude

Global Installation

npm install -g @pinkpixel/web-scout-mcp

Local Installation

npm install @pinkpixel/web-scout-mcp

🚀 Usage

Command Line

After installing globally, run:

web-scout-mcp

With MCP Clients

Add this to your MCP client's config.json (Claude Desktop, Cursor, etc.):

{
  "mcpServers": {
    "web-scout": {
      "command": "npx",
      "args": [
        "-y",
        "@pinkpixel/web-scout-mcp@latest"
      ]
    }
  }
}

Environment Variables

Set the WEB_SCOUT_DISABLE_AUTOSTART=1 environment variable when embedding the package and calling createServer() yourself. By default running the published entrypoint (for example node dist/index.js or npx @pinkpixel/web-scout-mcp) automatically bootstraps the stdio transport.

🧰 Tools

The server provides the following MCP tools:

🔍 DuckDuckGoWebSearch

Initiates a web search query using the DuckDuckGo search engine and returns a well-structured list of findings.

Input:

  • query (string): The search query string
  • maxResults (number, optional): Maximum number of results to return (default: 10)

Example:

{
  "query": "latest advancements in AI",
  "maxResults": 5
}

Output: A formatted list of search results with titles, URLs, and snippets.

📄 UrlContentExtractor

Fetches and extracts clean, readable content from web pages by removing unnecessary elements like scripts, styles, and navigation.

Input:

  • url: Either a single URL string or an array of URL strings

Example (single URL):

{
  "url": "https://example.com/article"
}

Example (multiple URLs):

{
  "url": [
    "https://example.com/article1",
    "https://example.com/article2"
  ]
}

Output: Extracted text content from the specified URL(s).

🛠️ Development

# Clone the repository
git clone https://github.com/pinkpixel-dev/web-scout-mcp.git
cd web-scout-mcp

# Install dependencies
npm install

# Build
npm run build

# Run
npm start

📚 Documentation

For more detailed information about the project, check out these resources:

📋 Requirements

  • Node.js >= 18.0.0
  • npm or yarn

📄 License

This project is licensed under the Apache 2.0 License.

<p align="center"> <sub>Made with ❤️ by <a href="https://pinkpixel.dev">Pink Pixel</a></sub> <br> <sub>✨ Dream it, Pixel it ✨</sub> </p>

Related MCP servers

Provide structured access to ClinicalTrials.gov data for searching, retrieving, and analyzing clin…

Provide AI assistants with real-time access to official SEC EDGAR filings and financial data. Enab…

0
Python
MIT
View repository →

Convert files between formats without quality loss. Speed up your workflow with fast, reliable con…

Search Ellen G. White’s writings by keyword to surface relevant quotations. Retrieve exact passage…

View repository →

Spot pre-launch products before they trend. Search the web and tech sites, extract and parse pages…

0
Python
MIT
View repository →

Look up DNS information for any domain to troubleshoot issues and gather insights. Get fast, relia…

1
Python
MIT
View repository →