Skip to content
Developer Tools

Documentation MCP

A public, no-auth MCP server that gives AI assistants semantic search and read access to the lobstr.io API documentation. To run scrapers in your account, see the MCP Server page instead.

The v1 API, for batchesSquids, tasks and runs: many calls on a schedule, delivered where you work. For one call that answers in seconds, use the API v2.

This server answers "how does lobstr.io work?" — it exposes the API documentation to AI assistants for semantic search and reading. It is read-only and unauthenticated; it cannot touch your account.

Looking to run scrapers from Claude or ChatGPT — discover a scraper, configure it, run it, and pull results in the conversation? That's the operational MCP Server, which connects to your account over OAuth. This page is only the documentation assistant.

Endpoint: https://docs.lobstr.io/mcp

2 Tools

Semantic search and full filesystem access to every docs page.

No Auth

Public endpoint — no API key needed to query the docs.

SSE Transport

HTTP + Server-Sent Events transport, compatible with all MCP clients.

Setup

claude mcp add lobstrio-docs \
  --transport http \
  https://docs.lobstr.io/mcp

Tools

Tool Description
search_lobstr_io Semantic search across all documentation — titles, descriptions, guides, and API references.
query_docs_filesystem_lobstr_io Read-only shell-like access to every docs page as .mdx files. Supports cat, head, rg, tree, ls, and more.

Example Prompts

Once connected, ask your AI assistant:

  • "How do I create a squid and start scraping Google Maps?"
  • "Show me the Python code for adding tasks to a scraper"
  • "What parameters does the LinkedIn Profile Scraper accept?"
  • "List all delivery configuration options (email, S3, webhook)"
  • "How do I handle rate limiting in the lobstr.io API?"

JSON-RPC Methods

Method Description
initialize Handshake — returns server info and capabilities
tools/list List all available tools with input schemas
tools/call Execute a tool with arguments