Integration

ScrapingBee integration

Web scraping API that handles headless browsers, proxy rotation, and CAPTCHA solving. Extract data from any website with JavaScript rendering, premium proxies, screenshots, and structured data extraction from Google, Amazon, Walmart, and YouTube.

Connect ScrapingBee How integrations work

Ask it in chat

Say what should happen.
The workflow builds itself.

When this happens, do that in ScrapingBee.Built from the 16 ScrapingBee tools below, on the connection you add once.

Common ScrapingBee use cases

Monitor product pricing
Collect video metadata
Track product availability
Scrape any website
Get video statistics
Search YouTube videos
Monitor Walmart prices
Visual page monitoring
Extract product details
Monitor search rankings

What you can do with ScrapingBee

Each of these is one operation on one endpoint, available both as a workflow step and as a tool an AI agent can call on its own. Nothing bundles several operations into one action, so what a run did stays readable afterwards.

Most endpoints run on the free plan. A few, mainly the ones that publish on your behalf, need a paid plan.

Data, 2 operations

ai_extractAi extractGETUses AI to intelligently extract data from a web page.
extract_dataExtract dataGETExtracts structured data from a page using CSS selectors.

Page, 2 operations

scrapeScrapeGETScrapes a web page with headless browser and proxy rotation.
scrape_postScrape postPOSTScrapes a URL using a POST request with a custom body.

Account, 1 operation

accountAccountGETChecks remaining API credits and account usage.

Ai response, 1 operation

chatgptChatgptGETSends a prompt to GPT and returns an AI-generated response.

Amazon product, 1 operation

amazon_productAmazon productGETGets detailed product data for an Amazon ASIN.

Amazon products, 1 operation

amazon_searchAmazon searchGETSearches Amazon and returns structured product results.

Browser, 1 operation

js_scenarioJs scenarioGETExecutes browser actions like click, scroll, and type before scraping.

Screenshot, 1 operation

screenshotScreenshotGETCaptures a screenshot of a web page as PNG.

Search results, 1 operation

google_searchGoogle searchGETScrapes Google search results as structured JSON.

Walmart product, 1 operation

walmart_productWalmart productGETGets detailed product data for a Walmart product.

Walmart products, 1 operation

walmart_searchWalmart searchGETSearches Walmart and returns structured product results.

Youtube transcript, 1 operation

youtube_transcriptYoutube transcriptGETGets the transcript or subtitles for a YouTube video.

Youtube video, 1 operation

youtube_metadataYoutube metadataGETGets detailed metadata for a YouTube video.

Youtube videos, 1 operation

youtube_searchYoutube searchGETSearches YouTube and returns structured video results.

ScrapingBee API rate limits

Concurrent request limits vary by plan. Exceeding returns HTTP 429.

These are the limits ScrapingBee documents, not ones LiveContext measured. They can change and often depend on your plan, so check the ScrapingBee documentation for current values.

Use ScrapingBee from Claude Code, Cursor or Codex

Connect ScrapingBee in LiveContext, create an API key in Settings, then add the LiveContext MCP server to your client. Its ScrapingBee operations become tools the client can call, next to every other integration you connected.

Claude Code

claude mcp add --transport http livecontext https://livecontext.ai/mcp --header "X-API-Key: YOUR_API_KEY"

Codex (~/.codex/config.toml)

[mcp_servers.livecontext]
url = "https://livecontext.ai/mcp"

[mcp_servers.livecontext.http_headers]
"X-API-Key" = "YOUR_API_KEY"

Cursor, Claude Desktop and other JSON configs

{
  "mcpServers": {
    "livecontext": {
      "type": "http",
      "url": "https://livecontext.ai/mcp",
      "headers": {
        "X-API-Key": "YOUR_API_KEY"
      }
    }
  }
}

Set up the MCP server step by step

How to connect ScrapingBee

Create your workspace
Sign up free. Nothing to install.
Connect ScrapingBee once
Add your ScrapingBee connection in Settings. Every tool from this integration reuses it, and secrets are encrypted at rest and visible only to you.
Describe the job in chat
The workflow builds itself in front of you and picks the endpoints it needs. Drag the steps yourself on the canvas whenever you would rather be explicit.

ScrapingBee integration FAQ

What can you do with the ScrapingBee integration?

LiveContext exposes 16 operations on ScrapingBee, covering data, page, account and ai response. Common uses include Monitor product pricing, Collect video metadata and Track product availability.

What are the ScrapingBee API rate limits?

Concurrent request limits vary by plan. Exceeding returns HTTP 429. Limits are set by ScrapingBee and can depend on your plan.