Scraper.is

Provides web scraping, screenshots, and content delivery via MCP for AI assistants.

typescript

8

GitHub Stars

typescript

Language

6 months ago

First Indexed

2 months ago

Catalog Refreshed

Documentation & install

Readme and setup notes from the catalogue, plus a client-ready config you can copy for your MCP host.

Installation

Add the following to your MCP client configuration file.

Configuration

View docs

{
  "mcpServers": {
    "ai-quill-scraperis-mcp": {
      "command": "scraperis-mcp",
      "args": [],
      "env": {
        "DEBUG": "*",
        "SCRAPERIS_API_KEY": "YOUR_API_KEY"
      }
    }
  }
}

You can empower AI assistants to extract up-to-date information from web pages by using the Scraper.is MCP integration. This MCP server lets an assistant request web content, capture page visuals, and receive results in multiple formats, all through the MCP protocol for seamless collaboration.

How to use

Use an MCP client to communicate with the Scraper.is MCP server. You will invoke the scrape tool to request content from any webpage, then receive the result in your preferred format.

How to install

Prerequisites: you need Node.js and npm installed on your system.

Install the MCP server client globally to enable MCP communication with Scraper.is.

# Install the Scraper.is MCP client globally
npm install -g scraperis-mcp

Set up your Scraper.is API key for authentication.

SCRAPERIS_API_KEY=your_api_key_here

Optionally, you can verify and interact with the MCP server using the MCP Inspector during development.

npx @modelcontextprotocol/inspector scraperis-mcp

For Claude Desktop users, configure the MCP server in your Claude Desktop configuration as shown below.

Additional setup for Claude Desktop

Add the following MCP server configuration to your Claude Desktop settings. This registers the Scraper.is MCP server under the name scraperis_scraper and provides the API key through the environment.

{
  "mcpServers": {
    "scraperis_scraper": {
      "command": "scraperis-mcp",
      "args": [],
      "env": {
        "SCRAPERIS_API_KEY": "your-api-key-here",
        "DEBUG": "*"
      }
    }
  }
}

Tools and formats

The Scraper.is MCP server exposes the scrape tool. You can request content in multiple formats, including markdown, html, screenshot, and json.

Supported formats include markdown, html, screenshot, and json. The tool can also provide quick content representations when needed.

Troubleshooting and notes

If you encounter authentication issues, double-check that SCRAPERIS_API_KEY is correctly set in your environment and that the key has the necessary permissions in the Scraper.is dashboard.

Restart Claude Desktop or your MCP client after updating configuration or environment variables to ensure changes take effect.

Security considerations

Keep your API key secure. Do not share your key or commit it to public source control. Use environment variables to inject credentials only at runtime.

Available tools

scrape

Scrapes content from a webpage and returns it in a requested format such as markdown, html, screenshot, or json.