PluginBench
MCP Server
Maintained

com.mcparmory/scrapingant MCP Server

com.mcparmory/scrapingant

Web scraping with JavaScript rendering and CAPTCHA handling for AI agents

What is the com.mcparmory/scrapingant MCP server?

The Scrapingant MCP server enables AI agents to scrape webpages with full JavaScript execution and CAPTCHA support. It extracts structured data from dynamic websites and handles complex rendering scenarios that standard HTTP requests cannot process.

This server provides web scraping capabilities designed for AI workflows, handling JavaScript-heavy sites and CAPTCHA challenges. Use it to extract structured data from websites that require rendering or interactive elements, enabling your AI agent to gather real-world web data for analysis, research, or integration tasks.

How to install com.mcparmory/scrapingant

Copy-paste configuration for popular MCP clients.

transport: stdio
Config generated by PluginBench — verify against the source before use.
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "scrapingant": {
      "command": "uvx",
      "args": [
        "mcparmory-scrapingant"
      ]
    }
  }
}

Tools & capabilities

Tools this server exposes to the agent.

  • Web scraping with JavaScript rendering — Scrape webpages with full JavaScript execution support
  • CAPTCHA handling — Automatically handle CAPTCHA challenges during scraping
  • Structured data extraction — Extract and structure data from scraped webpages

Use cases

  • Extract product information from e-commerce sites with dynamic content loading
  • Gather research data from JavaScript-heavy websites for analysis
  • Monitor competitor websites and pricing changes
  • Collect structured data from sites protected by basic CAPTCHA challenges
  • Automate data collection from web applications that require rendering

com.mcparmory/scrapingant MCP server FAQ

What is the Scrapingant MCP server?

It's an MCP server that provides web scraping capabilities with JavaScript rendering and CAPTCHA support, allowing AI agents to extract structured data from dynamic websites.

Does it handle JavaScript-rendered content?

Yes, the server supports full JavaScript execution, making it suitable for scraping single-page applications and dynamically-loaded content.

Can it bypass CAPTCHA?

The server includes CAPTCHA handling capabilities to work with sites that use basic CAPTCHA protection.

How do I install it in Cursor or Claude?

Install via pip (`pip install mcparmory-scrapingant`) or use uvx (`uvx mcparmory-scrapingant`), then configure it in your MCP client settings with appropriate API credentials.

Is authentication required?

Yes, you'll need API credentials from the Scrapingant service to use this server. Check the server's README for specific authentication setup instructions.

What are the main use cases?

Extract data from e-commerce sites, monitor competitor websites, gather research data from dynamic sites, and automate data collection from JavaScript-heavy applications.

README (reference)

Source of truth, from the repository.

<p align="center"> <img src="https://wjxawmrpsfuivlicnepc.supabase.co/storage/v1/object/public/newsletter/logo-armory-no-background.png" alt="MCP Armory" height="64"> </p> <h1 align="center">MCP Armory Registry</h1> <p align="center"> Production-ready MCP servers for popular APIs, generated by <a href="https://mcpblacksmith.com">MCP Blacksmith</a>. </p> <p align="center"> <a href="https://github.com/mcparmory/registry/stargazers"><img src="https://img.shields.io/github/stars/mcparmory/registry?style=flat&color=gold" alt="GitHub Stars"></a> <a href="https://github.com/mcparmory/registry/blob/main/servers/github/LICENSE"><img src="https://img.shields.io/badge/license-MIT-blue" alt="License"></a> <img src="https://img.shields.io/badge/servers-79-8A2BE2" alt="Servers"> <img src="https://img.shields.io/badge/python-3.11+-3776AB?logo=python&logoColor=white" alt="Python 3.11+"> </p> <p align="center"> <a href="#servers">Servers</a> &middot; <a href="#install--usage">Install & Usage</a> &middot; <a href="#features">Features</a> &middot; <a href="#how-servers-are-generated">How it works</a> &middot; <a href="#license">License</a> </p>

MCP servers that connect AI agents to real-world APIs. Each server is a standalone Python package — generated from the upstream OpenAPI spec using MCP Blacksmith and tested against the live API before release. Hosted on MCP Armory or run independently.

<!-- SERVERS:BEGIN -->

Servers

🧠 AI & Machine Learning   ElevenLabs · Linkup · Parallel · Perplexity AI · Ragie · Replicate

📊 Analytics   Ahrefs · Datadog · Google Analytics · Google Search Console · Linkly · Mixpanel · PostHog

⛓️ Blockchain & Crypto   Alchemy NFT

💼 CRM & Sales   Apollo

💬 Communication   Atlassian Confluence · Google Gmail · MailerSend · Mailtrap · Postmark · Resend · Slack

🗄️ Data & Databases   Enigma · Pinecone

🛠️ Developer Tools   AgentQL · Apify · Bitbucket · Bright Data · Browserbase · BuiltWith · Canvas · CircleCI · Codacy · Contentful Management · ConvertAPI · E2B · Firecrawl · GitHub · GitLab · LaunchDarkly · Postman · Scrapingant · Semrush AppCenter · Sentry

📄 Documents & Printing   PDF.co

🛒 E-commerce   Shopify Admin

💰 Finance   Alpha Vantage · Polygon · Ramp

👥 HR & Recruiting   BambooHR

☁️ Infrastructure   Globalping · Grafana · PagerDuty · Rootly · Runpod

⚖️ Legal & Compliance   NetLicensing

🗺️ Maps & Location   Google Maps Platform · IP2Location.io IP Geolocation · OpenCage Geocoding

📣 Marketing   Customer.io Journeys Track · Klaviyo

🎬 Media & Entertainment   Canva · Perigon

✅ Productivity   Airtable · Asana · Atlassian Jira · ClickUp · Figma · Google Sheets · Miro · Notion · Outline · Shortcut

🔍 Search   Algolia Search · Google Search

📦 Storage   Box · Files.com · Google Drive

📌 Other   Close

More servers are being added continuously.

<!-- SERVERS:END -->

Install & Usage

Every server is a standalone PyPI package (mcparmory-<server-name>). Each server's own README.md has full credential setup and configuration instructions.

# With uvx (no install needed)
uvx mcparmory-github

# With pip
pip install mcparmory-github
mcparmory-github

MCP client configuration (Claude Desktop, Cursor, Codex, Claude Code):

{
  "mcpServers": {
    "github": {
      "command": "uvx",
      "args": ["mcparmory-github"],
      "env": {
        "BEARER_TOKEN": "ghp_your_token_here"
      }
    }
  }
}

Features

Every server in this registry provides:

  • Full API coverage — all endpoints from the OpenAPI spec are exposed as MCP tools
  • Authentication — API key, Bearer token, Basic auth, OAuth2, JWT, OpenID Connect, and mutual TLS
  • Multi-auth — servers that support multiple auth methods let you configure whichever you prefer
  • Pydantic validation — request parameters are validated before sending to the API
  • Resilience — configurable retries with exponential backoff, connection pooling, and timeouts
  • Response sanitization — optional redaction of sensitive fields from API responses

How servers are generated

Servers are generated by MCP Blacksmith, an automated pipeline that:

  1. Parses an OpenAPI specification
  2. Transforms operations through LLM-driven passes (naming, parameter filtering, enhancement, classification)
  3. Generates a complete MCP server with auth, models, validation, and configuration
  4. Tests every tool against the live API using an autonomous agent
  5. Deploys passing servers to this registry

The generator targets Python 3.11+ and uses FastMCP as the MCP framework.

Contributing

Servers are auto-generated — don't edit server code directly. If you find an issue, open a GitHub Issue describing:

  • Broken or deprecated endpoints
  • Missing or incorrect parameters
  • Authentication problems
  • Incorrect request/response models

We'll re-generate the affected server with the fix. To request a new server, open an issue with a link to the API's OpenAPI spec or documentation.

License

Each generated server is released under the MIT License. The underlying APIs have their own terms of service — see individual server READMEs for details.


<p align="center"> <a href="https://mcparmory.com">MCP Armory</a> &middot; <a href="https://mcpblacksmith.com">MCP Blacksmith</a> &middot; <a href="https://docs.mcpblacksmith.com/quickstart">Docs</a> </p>

Related MCP servers

Manage Semrush app subscriptions, users, and send event notifications via MCP

30
Python
View repository →

Track errors, manage performance alerts, and configure dashboards and monitors with Sentry via MCP.

30
Python
View repository →

Manage Shopify store products, orders, customers, inventory, and configuration via AI agents.

30
Python
View repository →

AI-powered project management for Shortcut—track stories, sprints, and workflows in your MCP client

30
Python
View repository →

Manage Slack channels, conversations, users, and workspace apps programmatically via MCP.

30
Python
View repository →

Agent Interviews is an AI-powered research platform designed to conduct qualitative interviews an...

5
View repository →