What can you do with the Crawlbase integration?

LiveContext exposes 18 operations on Crawlbase, covering crawler, crawler job, page and stored page. Common uses include Sales prospecting, Clear crawler data and Submit login forms.

LiveContext

All integrations

Crawlbase integration

Web scraping and crawling API (formerly ProxyCrawl) with proxy rotation, JavaScript rendering, and structured data extraction. Crawl any website with automatic anti-bot bypass, geolocation proxies, and cloud storage for scraped results.

18 toolsAPI keyAPI docs

Connect Crawlbase How integrations work

Common Crawlbase use cases

Sales prospecting
Clear crawler data
Submit login forms
Clean up stored data
List stored crawl IDs
Monitor storage usage
Visual page monitoring
Check remaining credits
Bulk cleanup stored data
Check if a job is queued

What you can do with Crawlbase

Each of these is one operation on one endpoint, available both as a workflow step and as a tool an AI agent can call on its own. Nothing bundles several operations into one action, so what a run did stays readable afterwards.

Most endpoints run on the free plan. A few, mainly the ones that publish on your behalf, need a paid plan.

Crawler, 4 operations

POSTcrawler_pause
Pauses an enterprise crawler.
POSTcrawler_purge
Purges all pages from an enterprise crawler.
GETcrawler_stats
Returns enterprise crawler stats including concurrency and queue status.
POSTcrawler_unpause
Resumes a paused enterprise crawler.

Crawler job, 2 operations

POSTcrawler_delete
Deletes a specific job from an enterprise crawler.
GETcrawler_find
Finds a job in an enterprise crawler and returns its queue status.

Page, 2 operations

GETcrawl
Crawls a URL and returns the page content with proxy rotation.
POSTcrawl_post
Crawls a URL using POST to submit form data or JSON payloads.

Stored page, 2 operations

DELETEstorage_delete
Deletes a stored page from Cloud Storage.
GETstorage_get
Retrieves a stored page from Crawlbase Cloud Storage.

Stored pages, 2 operations

GETstorage_bulk
Retrieves multiple stored pages in bulk from Cloud Storage.
DELETEstorage_bulk_delete
Deletes multiple stored pages from Cloud Storage in bulk.

Account, 1 operation

GETaccount
Returns account info, credit balance, and usage statistics.

Leads, 1 operation

GETleads
Finds business leads and contact info for a domain.

Request ids, 1 operation

GETstorage_rids
Lists request IDs stored in Cloud Storage.

Scraped data, 1 operation

GETscraper
Extracts structured JSON data from web pages automatically.

Screenshot, 1 operation

GETscreenshots
Captures a screenshot of a web page as raw JPEG binary.

Storage count, 1 operation

GETstorage_total_count
Returns the total count of items in Cloud Storage.

Use Crawlbase from Claude Code, Cursor or Codex

Connect Crawlbase in LiveContext, create an API key in Settings, then add the LiveContext MCP server to your client. Its Crawlbase operations become tools the client can call, next to every other integration you connected.

Claude Code

claude mcp add --transport http livecontext https://livecontext.ai/mcp --header "X-API-Key: YOUR_API_KEY"

Codex (~/.codex/config.toml)

[mcp_servers.livecontext]
url = "https://livecontext.ai/mcp"

[mcp_servers.livecontext.http_headers]
"X-API-Key" = "YOUR_API_KEY"

Cursor, Claude Desktop and other JSON configs

{
  "mcpServers": {
    "livecontext": {
      "type": "http",
      "url": "https://livecontext.ai/mcp",
      "headers": {
        "X-API-Key": "YOUR_API_KEY"
      }
    }
  }
}

Set up the MCP server step by step

How to connect Crawlbase

Create your workspace
Sign up free. Nothing to install.
Connect Crawlbase once
Add your Crawlbase connection in Settings. Every tool from this integration reuses it, and secrets are encrypted at rest and visible only to you.
Describe the job in chat
The workflow builds itself in front of you and picks the endpoints it needs. Drag the steps yourself on the canvas whenever you would rather be explicit.

Crawlbase integration FAQ

What can you do with the Crawlbase integration?: LiveContext exposes 18 operations on Crawlbase, covering crawler, crawler job, page and stored page. Common uses include Sales prospecting, Clear crawler data and Submit login forms.