Webscraper Io MCP server

Connect Webscraper Io to Claude, ChatGPT, Cursor, Claude Code, Codex, Gemini, GitHub Copilot and any other MCP client, for your whole team. Metorial adds security, governance, and tracing, and gives everyone one Magic MCP URL to connect.

What you can do with the Webscraper Io MCP server

Ask your agent in plain language. Each of these maps to a real tool on the server.

  • Use the get sitemap tool in Webscraper Io
  • Use the get account tool in Webscraper Io
  • Use the get data quality tool in Webscraper Io
  • Use the get problematic urls tool in Webscraper Io
  • Use the delete sitemap tool in Webscraper Io
  • Use the get scraping job tool in Webscraper Io

Supported Tools

get_sitemap

Get Sitemap

Retrieve a single sitemap by its ID, including its full configuration with selectors and start URLs.

get_account

Get Account

Retrieve account information including the user's email, name, and remaining page credits.

get_data_quality

Get Data Quality

Retrieve the data quality report for a scraping job. Reports whether the scraped data meets configurable thresholds for record count, failed/empty page rates, and column fill rates.

get_problematic_urls

Get Problematic URLs

Retrieve URLs that encountered problems during a scraping job, including empty pages, failed requests, and pages with no extracted values.

delete_sitemap

Delete Sitemap

Permanently delete a sitemap and all its associated configuration. This action cannot be undone.

get_scraping_job

Get Scraping Job

Retrieve the full status and statistics of a scraping job, including page counts, execution progress, and timing information.

delete_scraping_job

Delete Scraping Job

Permanently delete a scraping job and its associated data. This action cannot be undone.

list_scraping_jobs

List Scraping Jobs

List scraping jobs with pagination support. Optionally filter by sitemap ID or tag.

create_scraping_job

Create Scraping Job

Execute a sitemap by creating a new scraping job. Configure the driver, proxy, timing, and optionally override start URLs. The job will begin processing and can be monitored using the Get Scraping Job tool.

manage_scheduler

Manage Scheduler

Enable, disable, or retrieve the cron-based scheduler for a sitemap. When enabled, scraping jobs run automatically at specified intervals. Use action "get" to view current settings, "enable" to configure and activate, or "disable" to turn off.

create_sitemap

Create Sitemap

Create a new sitemap that defines the structure and rules for scraping a website. A sitemap includes start URLs and a tree of CSS selectors that specify what data to extract from each page.

update_sitemap

Update Sitemap

Update an existing sitemap's configuration including its name, start URLs, and selectors. The full sitemap definition must be provided.

list_sitemaps

List Sitemaps

List all sitemaps in your account with pagination support. Optionally filter by tag name.

download_scraped_data

Download Scraped Data

Download the scraped data from a completed scraping job as a JSONL or CSV file. Also returns JSON records or CSV text for compatibility.

continue_scraping_job

Continue Scraping Job

Continue a stopped or pausable scraping job. Omitted execution settings retain the job’s current values. Use get_scraping_job to monitor progress.

stop_scraping_job

Stop Scraping Job

Request that a running scraping job stop. Use get_scraping_job to monitor when it reaches stopped status.

Connect Webscraper Io to your AI client

Every client uses the same Magic MCP URL, and so does any other MCP client. Add it once and sign in with SSO.

  1. Enable Webscraper Io in Metorial. In your Metorial portal, enable the Webscraper Io MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
  2. Add a custom connector. Open Customize, then Connectors. Select Add, then Custom, then Web.
  3. Paste your Metorial MCP URL. Name it Metorial, paste your Magic MCP URL (<your-magic-mcp-url>) and continue.
  4. Sign in. Select Add and sign in to load Webscraper Io tools.

Run Webscraper Io through the Metorial gateway

One governed layer for every app your agents reach, not a separate connector per tool.

  • Give Webscraper Io and every other app to your whole team through one MCP gateway, behind your SSO.
  • Scope which teams and agents can use Webscraper Io tools with role-based access control, and trace every call.
  • Prefer to run it yourself? Metorial is open source and self-hostable.

More integrations teams use with Webscraper Io

GitHub

Manage repositories, issues, and pull requests. Create and configure branches, star repositories, review code, and merge changes. Automate CI/CD workflows with GitHub Actions, manage workflow runs, secrets, and artifacts. Track issues with labels, milestones, and assignees. Search across code, repositories, issues, and users. Manage organizations, teams, and memberships. Create and manage projects, gists, packages, deployments, and environments. Access security alerts including code scanning, secret scanning, and Dependabot alerts. Read and write file contents in repositories. Manage webhooks, notifications, and codespaces.

Salesforce

Manage CRM data including Accounts, Contacts, Leads, Opportunities, Cases, and custom objects. Create, read, update, and delete records. Query data using SOQL and search across objects using SOSL. Perform bulk data operations for large-scale imports, exports, and migrations. Execute composite requests to batch multiple operations in a single API call. Access analytics, reports, and dashboards. Manage files and attachments associated with records. Interact with Chatter feeds, posts, and groups for social collaboration. Manage org metadata including custom objects, fields, layouts, and workflows. Query data using GraphQL for precise data retrieval across related objects.

Sharepoint

Manage SharePoint sites, document libraries, lists, and files. Create, read, update, and delete lists and list items with custom columns. Resolve site users to numeric Person/Group LookupId values. Upload, download, move, copy, and version files in document libraries. Search across sites, files, folders, lists, and list items using Microsoft Search. Manage permissions at site, list, and item levels with granular access control. Define and manage content types and site columns. Retrieve site properties and search for sites across Microsoft 365.

Airtable

Create, read, update, and delete records in Airtable bases and tables. Manage base schemas including creating tables and fields. Filter records using formulas, sort by fields, and scope queries to specific views. Upsert records to find, create, or update in a single call. Upload attachments to records, read and write record comments, list accessible bases, and receive real-time base change events through webhooks.

Sentry

Track, manage, and resolve application errors and performance issues. List, query, and bulk-update issues and error events with filters like status, assignment, and tags. Create and manage releases, associate commits, and upload source maps. Configure issue alert rules and metric alert rules with notification actions. Set up cron monitors to detect missed or failed scheduled jobs. Build custom dashboards with configurable widgets. Run ad-hoc Discover queries across errors and transactions for performance analysis. Manage organizations, teams, projects, and members. Provision users via SCIM. Access session replay data.

Bitbucket

Manage Git repositories, pull requests, and CI/CD pipelines on Bitbucket Cloud. Create, fork, and configure repositories within workspaces and projects. Create, review, approve, merge, and decline pull requests with inline code comments. Browse source code, list commits, and manage branches and tags. Trigger, monitor, and manage Bitbucket Pipelines. List workspace members, configure repository default reviewers and branch restrictions, create and manage repository webhooks, and search code across repositories.

Technical notes for Webscraper Io

Create, manage, and execute web scraping jobs to extract structured data from websites. Define sitemaps with CSS selectors and start URLs, run scraping jobs with configurable drivers (fast or full JavaScript), proxies, and timing controls. Monitor job status and data quality, download scraped data in JSON or CSV format, and schedule recurring scraping jobs using cron expressions. Retrieve account information and remaining page credits.

Frequently asked questions

Common questions about connecting Webscraper Io to AI agents with Metorial.

  1. How many tools does the Webscraper Io MCP server have?
    The Webscraper Io MCP server exposes 16 tools, including Get Sitemap, Get Account, Get Data Quality. Each one is governed and traced through Metorial.
  2. Webscraper Io exposes tools your agents call on demand; it does not publish event triggers yet. Everything still runs through one governed MCP URL.
  3. Any MCP client, including VS Code, Windsurf, Zed, OpenCode and Grok. Each one reaches the Webscraper Io MCP server through the same Metorial URL.
  4. Use role-based access control to decide which teams, users, and agents can use Webscraper Io and which of its tools they can call.
  5. Yes. Metorial is open source, so you can run the Webscraper Io MCP server yourself or use the hosted gateway.

Connect Webscraper Io to production AI agents

See how Metorial gives your team governed access to Webscraper Io, with tracing and security controls built in.