Skip to main content
Provision a key and make your first call in under a minute.
REST today

SuperScraper + GitHub Copilot

GitHub Copilot in VS Code can scrape and search the web through the local MCP server, or by calling the REST API.

Call it from GitHub Copilot

Hosted MCP is coming soon. Until it ships, these tools call the REST API with a Bearer key.

This call runs today. Set SUPERSCRAPER_API_KEY to a key from the dashboard, or let the agent mint its own with POST /v1/keys/provision. See every endpoint.

curl -X POST https://api.superscraper.dev/v1/scrape \
  -H "Authorization: Bearer $SUPERSCRAPER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{ "url": "https://example.com" }'

Install

Every snippet reads your key from SUPERSCRAPER_API_KEY, asks for it in the client’s own password prompt, or leaves a placeholder for you to fill in on your own machine. None of them contains a key.

GitHub Copilot

1. Paste this prompt into GitHub Copilot

The agent reads the onboarding files, mints its own free key into an environment variable and makes one test call.

Set up the SuperScraper web data API in this project.
1. Read https://superscraper.dev/auth.md and https://superscraper.dev/llms.txt and follow them.
2. Create a free API key with POST https://api.superscraper.dev/v1/keys/provision. Save it as the environment variable SUPERSCRAPER_API_KEY. Never write the key into code, commits, logs or chat.
3. Make one test call: POST https://api.superscraper.dev/v1/scrape with {"url":"https://example.com"} and show me the completeness score and the fetch method from the response.
4. Add a short note on how this project calls SuperScraper to .github/copilot-instructions.md.

2. Or connect the local MCP server

The MCP server runs on your machine over stdio and calls the REST API with your key. It is not on npm yet, so the command points at a checkout of the server; replace the path with yours. Where it goes: .vscode/mcp.json in the project (VS Code asks for the key the first time the server starts). GitHub Copilot MCP docs.

The file holds no key. The first time the server starts, VS Code asks for your key in a password prompt and stores it for you.

{
  "inputs": [
    {
      "type": "promptString",
      "id": "superscraper-key",
      "description": "SuperScraper API key",
      "password": true
    }
  ],
  "servers": {
    "superscraper": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "tsx",
        "/path/to/superscraper/packages/mcp/src/index.ts"
      ],
      "env": {
        "SUPERSCRAPER_API_URL": "https://api.superscraper.dev",
        "SUPERSCRAPER_API_KEY": "${input:superscraper-key}"
      }
    }
  }
}

3. Or call the REST API

Mint a free key, export it as SUPERSCRAPER_API_KEY, then call any endpoint.

curl -X POST https://api.superscraper.dev/v1/keys/provision \
  -H "Content-Type: application/json" \
  -d '{"label":"my-agent"}'

Hosted MCPComing soon

Use local MCP or the REST API until hosted MCP opens.

Call SuperScraper from GitHub Copilot

Mint a key, or let your agent mint its own. The free plan needs no card.

Get an API keyRead the docs