Skip to main content
REST today

SuperScraper + Gemini CLI

Gemini CLI can scrape and search the web through the local MCP server, or by calling the REST API.

Call it from Gemini CLI

Hosted MCP is coming soon. Until it ships, these tools call the REST API with a Bearer key.

This call runs today. Set SUPERSCRAPER_API_KEY to a key from the dashboard, or let the agent mint its own with POST /v1/keys/provision. See every endpoint.

curl -X POST https://api.superscraper.dev/v1/scrape \
  -H "Authorization: Bearer $SUPERSCRAPER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{ "url": "https://example.com" }'

Install

Every snippet reads your key from SUPERSCRAPER_API_KEY, asks for it in the client’s own password prompt, or leaves a placeholder for you to fill in on your own machine. None of them contains a key.

Gemini CLI

1. Paste this prompt into Gemini CLI

The agent reads the onboarding files, mints its own free key into an environment variable and makes one test call.

Set up the SuperScraper web data API in this project.
1. Read https://superscraper.dev/auth.md and https://superscraper.dev/llms.txt and follow them.
2. Create a free API key with POST https://api.superscraper.dev/v1/keys/provision. Save it as the environment variable SUPERSCRAPER_API_KEY. Never write the key into code, commits, logs or chat.
3. Make one test call: POST https://api.superscraper.dev/v1/scrape with {"url":"https://example.com"} and show me the completeness score and the fetch method from the response.
4. Add a short note on how this project calls SuperScraper to GEMINI.md.

2. Or connect the local MCP server

The MCP server runs on your machine over stdio and calls the REST API with your key. It is not on npm yet, so the command points at a checkout of the server; replace the path with yours. Where it goes: .gemini/settings.json in the project, or ~/.gemini/settings.json for every project. Gemini CLI MCP docs.

gemini mcp add \
  -e SUPERSCRAPER_API_URL=https://api.superscraper.dev \
  -e SUPERSCRAPER_API_KEY="$SUPERSCRAPER_API_KEY" \
  superscraper npx tsx /path/to/superscraper/packages/mcp/src/index.ts

3. Or call the REST API

Mint a free key, export it as SUPERSCRAPER_API_KEY, then call any endpoint.

curl -X POST https://api.superscraper.dev/v1/keys/provision \
  -H "Content-Type: application/json" \
  -d '{"label":"my-agent"}'

Hosted MCPComing soon

Use local MCP or the REST API until hosted MCP opens.

Call SuperScraper from Gemini CLI

Mint a key, or let your agent mint its own. The free plan needs no card.