Scrapfly MCP server

Connect Scrapfly to Claude, ChatGPT, Cursor, Claude Code, Codex, Gemini, GitHub Copilot and any other MCP client, for your whole team. Metorial adds security, governance, and tracing, and gives everyone one Magic MCP URL to connect.

What you can do with the Scrapfly MCP server

Ask your agent in plain language. Each of these maps to a real tool on the server.

  • Use the get account info tool in Scrapfly
  • Use the get crawl status tool in Scrapfly
  • Use the start crawl tool in Scrapfly
  • Use the get crawl results tool in Scrapfly
  • Use the extract data tool in Scrapfly
  • Use the scrape webpage tool in Scrapfly

Supported Tools

get_account_info

Get Account Info

Retrieve Scrapfly account information including current project details, usage statistics, remaining credits, concurrency limits, and subscription information.

get_crawl_status

Get Crawl Status

Retrieve the current status and progress of a running or completed crawl job. Returns page counts, credit usage, duration, and completion state.

start_crawl

Start Crawl

Start a recursive website crawl from a given URL. The crawler automatically discovers and follows links, respecting configurable limits for page count, depth, duration, and budget. Supports URL path filtering, external domain control, proxy rotation, anti-bot bypass, and multiple content formats.

get_crawl_results

Get Crawl Results

Retrieve crawled URLs and optionally a page of extracted content from a completed or running crawl. The URL list contains up to the first 50 records for the requested status; content can be paginated or filtered to one URL.

extract_data

Extract Data

Extract structured data from document content using Scrapfly's standalone Extraction API. Supports three extraction methods: AI auto-extraction with predefined models (product, article, review, real estate), LLM prompt-based extraction with natural language instructions, and custom template-based extraction with CSS/XPath/JMESPath rules. Accepts HTML, XML, JSON, CSV, RSS, Markdown, and plain text input.

scrape_webpage

Scrape Webpage

Scrape any web page and retrieve its content. Supports JavaScript rendering for dynamic pages, anti-bot bypass (ASP), proxy rotation across 120+ countries, and multiple output formats (raw HTML, clean HTML, JSON, markdown, text). Can also perform inline data extraction using AI models, LLM prompts, or custom templates during the scrape.

capture_screenshot

Capture Screenshot

Capture a screenshot of any web page. Supports full-page captures, viewport-only captures, or targeting specific elements via CSS selectors. Includes options for ad/banner blocking, dark mode, custom viewport resolution, accessibility testing, and JavaScript execution before capture.

cancel_crawl

Cancel Crawl

Stop a pending or running website crawl. Already collected pages remain available. Cancelling a finished crawl succeeds without changing its outcome.

download_crawl_artifact

Download Crawl Artifact

Download a completed or cancelled crawl as a compressed WARC archive or a HAR file containing its collected HTTP requests, responses, and content.

Connect Scrapfly to your AI client

Every client uses the same Magic MCP URL, and so does any other MCP client. Add it once and sign in with SSO.

  1. Enable Scrapfly in Metorial. In your Metorial portal, enable the Scrapfly MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
  2. Add a custom connector. Open Customize, then Connectors. Select Add, then Custom, then Web.
  3. Paste your Metorial MCP URL. Name it Metorial, paste your Magic MCP URL (<your-magic-mcp-url>) and continue.
  4. Sign in. Select Add and sign in to load Scrapfly tools.

Run Scrapfly through the Metorial gateway

One governed layer for every app your agents reach, not a separate connector per tool.

  • Give Scrapfly and every other app to your whole team through one MCP gateway, behind your SSO.
  • Scope which teams and agents can use Scrapfly tools with role-based access control, and trace every call.
  • Prefer to run it yourself? Metorial is open source and self-hostable.

More integrations teams use with Scrapfly

Google Sheets

Create, read, and update spreadsheets and their cell data. Read and write values to individual cells, ranges, or multiple ranges using A1 notation or named ranges. Apply cell formatting including text styles, backgrounds, borders, number formats, and conditional formatting. Manage sheets (tabs) within a spreadsheet—add, delete, copy, rename, and reorder them. Create and manage embedded charts, pivot tables, filter views, data validation rules, protected ranges, named ranges, and merged cells. Perform batch operations to apply multiple updates atomically.

GitHub

Manage repositories, issues, and pull requests. Create and configure branches, star repositories, review code, and merge changes. Automate CI/CD workflows with GitHub Actions, manage workflow runs, secrets, and artifacts. Track issues with labels, milestones, and assignees. Search across code, repositories, issues, and users. Manage organizations, teams, and memberships. Create and manage projects, gists, packages, deployments, and environments. Access security alerts including code scanning, secret scanning, and Dependabot alerts. Read and write file contents in repositories. Manage webhooks, notifications, and codespaces.

Salesforce

Manage CRM data including Accounts, Contacts, Leads, Opportunities, Cases, and custom objects. Create, read, update, and delete records. Query data using SOQL and search across objects using SOSL. Perform bulk data operations for large-scale imports, exports, and migrations. Execute composite requests to batch multiple operations in a single API call. Access analytics, reports, and dashboards. Manage files and attachments associated with records. Interact with Chatter feeds, posts, and groups for social collaboration. Manage org metadata including custom objects, fields, layouts, and workflows. Query data using GraphQL for precise data retrieval across related objects.

Sharepoint

Manage SharePoint sites, document libraries, lists, and files. Create, read, update, and delete lists and list items with custom columns. Resolve site users to numeric Person/Group LookupId values. Upload, download, move, copy, and version files in document libraries. Search across sites, files, folders, lists, and list items using Microsoft Search. Manage permissions at site, list, and item levels with granular access control. Define and manage content types and site columns. Retrieve site properties and search for sites across Microsoft 365.

Airtable

Create, read, update, and delete records in Airtable bases and tables. Manage base schemas including creating tables and fields. Filter records using formulas, sort by fields, and scope queries to specific views. Upsert records to find, create, or update in a single call. Upload attachments to records, read and write record comments, list accessible bases, and receive real-time base change events through webhooks.

Google Drive

Upload, download, create, copy, move, rename, trash, and permanently delete files and folders in Google Drive. Search for files using complex queries filtering by name, MIME type, owner, modification date, labels, and other metadata. Share files and folders with specific users, groups, or domains with role-based permissions (owner, writer, commenter, reader). Manage shared drives and their members. Export Google Workspace files (Docs, Sheets, Slides) to standard formats like PDF, DOCX, and XLSX. Track file revision history and restore earlier versions. Create, read, update, and delete threaded comments and replies on files. Read label definitions and search files by label. Browse the Drive apps installed for your account. Store app-specific data in a hidden per-user folder.

Technical notes for Scrapfly

Scrape web pages with anti-bot bypass, proxy rotation, and JavaScript rendering. Capture full-page or targeted screenshots, extract structured document data, and crawl websites with configurable depth and URL filtering. Monitor or cancel crawls, retrieve paginated content, download WARC or HAR archives, and inspect account usage and subscription details.

Frequently asked questions

Common questions about connecting Scrapfly to AI agents with Metorial.

  1. How many tools does the Scrapfly MCP server have?
    The Scrapfly MCP server exposes 9 tools, including Get Account Info, Get Crawl Status, Start Crawl. Each one is governed and traced through Metorial.
  2. Scrapfly exposes tools your agents call on demand; it does not publish event triggers yet. Everything still runs through one governed MCP URL.
  3. Any MCP client, including VS Code, Windsurf, Zed, OpenCode and Grok. Each one reaches the Scrapfly MCP server through the same Metorial URL.
  4. Use role-based access control to decide which teams, users, and agents can use Scrapfly and which of its tools they can call.
  5. Yes. Metorial is open source, so you can run the Scrapfly MCP server yourself or use the hosted gateway.

Connect Scrapfly to production AI agents

See how Metorial gives your team governed access to Scrapfly, with tracing and security controls built in.