Integration

Crawlbase integration

Web scraping and crawling API (formerly ProxyCrawl) with proxy rotation, JavaScript rendering, and structured data extraction. Crawl any website with automatic anti-bot bypass, geolocation proxies, and cloud storage for scraped results.

Connect Crawlbase How integrations work

Ask it in chat

Say what should happen.
The workflow builds itself.

When this happens, do that in Crawlbase.Built from the 18 Crawlbase tools below, on the connection you add once.

Common Crawlbase use cases

Sales prospecting
Clear crawler data
Submit login forms
Clean up stored data
List stored crawl IDs
Monitor storage usage
Visual page monitoring
Check remaining credits
Bulk cleanup stored data
Check if a job is queued

What you can do with Crawlbase

Each of these is one operation on one endpoint, available both as a workflow step and as a tool an AI agent can call on its own. Nothing bundles several operations into one action, so what a run did stays readable afterwards.

Most endpoints run on the free plan. A few, mainly the ones that publish on your behalf, need a paid plan.

Crawler, 4 operations

crawler_pauseCrawler pausePOSTPauses an enterprise crawler.
crawler_purgeCrawler purgePOSTPurges all pages from an enterprise crawler.
crawler_statsCrawler statsGETReturns enterprise crawler stats including concurrency and queue status.
crawler_unpauseCrawler unpausePOSTResumes a paused enterprise crawler.

Crawler job, 2 operations

crawler_deleteCrawler deletePOSTDeletes a specific job from an enterprise crawler.
crawler_findCrawler findGETFinds a job in an enterprise crawler and returns its queue status.

Page, 2 operations

crawlCrawlGETCrawls a URL and returns the page content with proxy rotation.
crawl_postCrawl postPOSTCrawls a URL using POST to submit form data or JSON payloads.

Stored page, 2 operations

storage_deleteStorage deleteDELETEDeletes a stored page from Cloud Storage.
storage_getStorage getGETRetrieves a stored page from Crawlbase Cloud Storage.

Stored pages, 2 operations

storage_bulkStorage bulkGETRetrieves multiple stored pages in bulk from Cloud Storage.
storage_bulk_deleteStorage bulk deleteDELETEDeletes multiple stored pages from Cloud Storage in bulk.

Account, 1 operation

accountAccountGETReturns account info, credit balance, and usage statistics.

Leads, 1 operation

leadsLeadsGETFinds business leads and contact info for a domain.

Request ids, 1 operation

storage_ridsStorage ridsGETLists request IDs stored in Cloud Storage.

Scraped data, 1 operation

scraperScraperGETExtracts structured JSON data from web pages automatically.

Screenshot, 1 operation

screenshotsScreenshotsGETCaptures a screenshot of a web page as raw JPEG binary.

Storage count, 1 operation

storage_total_countStorage total countGETReturns the total count of items in Cloud Storage.

Use Crawlbase from Claude Code, Cursor or Codex

Connect Crawlbase in LiveContext, create an API key in Settings, then add the LiveContext MCP server to your client. Its Crawlbase operations become tools the client can call, next to every other integration you connected.

Claude Code

claude mcp add --transport http livecontext https://livecontext.ai/mcp --header "X-API-Key: YOUR_API_KEY"

Codex (~/.codex/config.toml)

[mcp_servers.livecontext]
url = "https://livecontext.ai/mcp"

[mcp_servers.livecontext.http_headers]
"X-API-Key" = "YOUR_API_KEY"

Cursor, Claude Desktop and other JSON configs

{
  "mcpServers": {
    "livecontext": {
      "type": "http",
      "url": "https://livecontext.ai/mcp",
      "headers": {
        "X-API-Key": "YOUR_API_KEY"
      }
    }
  }
}

Set up the MCP server step by step

How to connect Crawlbase

Create your workspace
Sign up free. Nothing to install.
Connect Crawlbase once
Add your Crawlbase connection in Settings. Every tool from this integration reuses it, and secrets are encrypted at rest and visible only to you.
Describe the job in chat
The workflow builds itself in front of you and picks the endpoints it needs. Drag the steps yourself on the canvas whenever you would rather be explicit.

Crawlbase integration FAQ

What can you do with the Crawlbase integration?

LiveContext exposes 18 operations on Crawlbase, covering crawler, crawler job, page and stored page. Common uses include Sales prospecting, Clear crawler data and Submit login forms.