Web Fetch

Provides web content fetching, summarization, comparison, and extraction capabilities through MCP tools.

javascript

6

GitHub Stars

javascript

Language

4 months ago

First Indexed

2 months ago

Catalog Refreshed

Documentation & install

Readme and setup notes from the catalogue, plus a client-ready config you can copy for your MCP host.

Installation

Add the following to your MCP client configuration file.

Configuration

View docs

{
  "mcpServers": {
    "kylinmountain-web-fetch-mcp": {
      "command": "web-fetch-mcp",
      "args": [],
      "env": {
        "GEMINI_API_KEY": "YOUR_GEMINI_API_KEY"
      }
    }
  }
}

You can run a Web Fetch MCP Server to fetch, summarize, compare, and extract information from web content. It supports processing multiple URLs in one request, transforms HTML into readable text, and includes safety features to protect against SSRF while offering configurable timeouts and content limits to suit your needs.

How to use

You will run the MCP server as a local process and connect your MCP client to it. Use the three core tools to handle web content: summarize_web to generate concise summaries, compare_web to analyze differences across multiple pages, and extract_web to pull specific information using prompts.

How to install

Install the server globally with Node's package manager to make the command available system-wide.

npm install -g web-fetch-mcp

Additional sections

Configuration and usage details help you tailor the server to your environment.

Security

The server protects against Server-Side Request Forgery by blocking requests to private IP addresses, ensuring safer web content retrieval.

Tool access and environment variables are provided through MCP client configurations. You can set API keys and other environment variables as shown in the examples.

Examples illustrate how to enable the server with an MCP client and provide the required authentication tokens.

If you run this server from a local clone, you can start it using Node and the built dist index file, with your Gemini API key configured in the environment.

{
  "mcpServers": {
    "web-fetch-mcp": {
      "type": "stdio",
      "command": "node",
      "args": ["/path/to/web-fetch-mcp/dist/index.js"],
      "env": {
        "GEMINI_API_KEY": "YOUR_GEMINI_API_KEY"
      }
    }
  }
}

Available tools

summarize_web

Summarizes content from one or more URLs, producing a concise overview of the main points.

compare_web

Compares content across multiple URLs to highlight similarities and differences.

extract_web

Extracts specific information from web content using natural language prompts.