Scrapegraph Ai MCP server

Connect Scrapegraph Ai to Claude, ChatGPT, Cursor, Claude Code, Codex, Gemini, GitHub Copilot and any other MCP client, for your whole team. Metorial adds security, governance, and tracing, and gives everyone one Magic MCP URL to connect.

What you can do with the Scrapegraph Ai MCP server

Ask your agent in plain language. Each of these maps to a real tool on the server.

  • Use the convert to markdown tool in Scrapegraph Ai
  • Use the get credits tool in Scrapegraph Ai
  • Use the crawl website tool in Scrapegraph Ai
  • Use the get request status tool in Scrapegraph Ai
  • Use the discover sitemap tool in Scrapegraph Ai
  • Use the web search tool in Scrapegraph Ai

Supported Tools

markdownify

Convert to Markdown

Uses the legacy v1 API and requires a compatible legacy API key. Converts a webpage into clean, well-formatted Markdown. Strips ads, navigation, and irrelevant elements while preserving content structure, images, and links. Useful for preparing web content for LLMs, documentation, or content migration.

get_credits

Get Credits

Uses the legacy v1 API and requires a compatible legacy API key. Retrieves the current API credit balance and total credits used for the account.

crawl_website

Crawl Website

Uses the legacy v1 API and requires a compatible legacy API key. Crawls multiple pages of a website starting from a given URL, following links with configurable depth and breadth. Two modes: **AI extraction** (structured output with a prompt) and **markdown conversion** (no AI, lower cost). Supports crawl rules for include/exclude paths, sitemap-based discovery, and webhook notifications on completion.

get_request_status

Get Request Status

Uses the legacy v1 API and requires a compatible legacy API key. Retrieves the status and results of a previous scraping request by its request ID. Supports all service types: smartscraper, searchscraper, markdownify, scrape, crawl, sitemap, and agentic-scrapper.

discover_sitemap

Discover Sitemap

Uses the legacy v1 API and requires a compatible legacy API key. Extracts and returns the sitemap structure of a website by discovering URLs from sitemap.xml, robots.txt, and common sitemap locations. Useful for understanding site organization, URL discovery, and SEO audits before performing a larger crawl.

raw_scrape

Fetch Raw HTML

Uses the legacy v1 API and requires a compatible legacy API key. Fetches and returns the raw HTML of a webpage with JavaScript rendering support. Useful when you need the complete page source rather than AI-processed output. Optionally extracts branding information (colors, fonts, typography, UI styles, metadata).

agentic_scrape

Agentic Scrape

Uses the legacy v1 API and requires a compatible legacy API key. Automates browser interactions using a sequence of natural language steps before extracting data. Can click buttons, fill forms, type text, scroll, navigate, and log in to websites. Supports session persistence for multi-step workflows and optional AI extraction with schema support. Without AI extraction, returns raw markdown.

smart_scrape

Smart Scrape

Uses the legacy v1 API and requires a compatible legacy API key. Extracts structured data from a single webpage using AI and a natural language prompt. Provide a URL (or raw HTML/Markdown content) and describe what data you want extracted; returns structured JSON. Supports custom output schemas for consistent data structure, infinite scroll handling, stealth mode for anti-detection, and proxy routing by country.

generate_schema

Generate Extraction Schema

Generate a JSON schema from a natural language description, or extend an existing schema with additional fields, using the current ScrapeGraphAI API.

extract_data

Extract Structured Data

Extract structured data from a webpage, HTML, or Markdown using the current ScrapeGraphAI API and a natural language prompt. Optionally constrain the result with a JSON schema.

list_history

List Request History

List recent requests from the current ScrapeGraphAI API, newest first, with identifiers, status, timing, errors, and pagination. Filter by service or workflow session.

Connect Scrapegraph Ai to your AI client

Every client uses the same Magic MCP URL, and so does any other MCP client. Add it once and sign in with SSO.

  1. Enable Scrapegraph Ai in Metorial. In your Metorial portal, enable the Scrapegraph Ai MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
  2. Add a custom connector. Open Customize, then Connectors. Select Add, then Custom, then Web.
  3. Paste your Metorial MCP URL. Name it Metorial, paste your Magic MCP URL (<your-magic-mcp-url>) and continue.
  4. Sign in. Select Add and sign in to load Scrapegraph Ai tools.

Run Scrapegraph Ai through the Metorial gateway

One governed layer for every app your agents reach, not a separate connector per tool.

  • Give Scrapegraph Ai and every other app to your whole team through one MCP gateway, behind your SSO.
  • Scope which teams and agents can use Scrapegraph Ai tools with role-based access control, and trace every call.
  • Prefer to run it yourself? Metorial is open source and self-hostable.

More integrations teams use with Scrapegraph Ai

GitHub

Manage repositories, issues, and pull requests. Create and configure branches, star repositories, review code, and merge changes. Automate CI/CD workflows with GitHub Actions, manage workflow runs, secrets, and artifacts. Track issues with labels, milestones, and assignees. Search across code, repositories, issues, and users. Manage organizations, teams, and memberships. Create and manage projects, gists, packages, deployments, and environments. Access security alerts including code scanning, secret scanning, and Dependabot alerts. Read and write file contents in repositories. Manage webhooks, notifications, and codespaces.

Salesforce

Manage CRM data including Accounts, Contacts, Leads, Opportunities, Cases, and custom objects. Create, read, update, and delete records. Query data using SOQL and search across objects using SOSL. Perform bulk data operations for large-scale imports, exports, and migrations. Execute composite requests to batch multiple operations in a single API call. Access analytics, reports, and dashboards. Manage files and attachments associated with records. Interact with Chatter feeds, posts, and groups for social collaboration. Manage org metadata including custom objects, fields, layouts, and workflows. Query data using GraphQL for precise data retrieval across related objects.

Sharepoint

Manage SharePoint sites, document libraries, lists, and files. Create, read, update, and delete lists and list items with custom columns. Resolve site users to numeric Person/Group LookupId values. Upload, download, move, copy, and version files in document libraries. Search across sites, files, folders, lists, and list items using Microsoft Search. Manage permissions at site, list, and item levels with granular access control. Define and manage content types and site columns. Retrieve site properties and search for sites across Microsoft 365.

Airtable

Create, read, update, and delete records in Airtable bases and tables. Manage base schemas including creating tables and fields. Filter records using formulas, sort by fields, and scope queries to specific views. Upsert records to find, create, or update in a single call. Upload attachments to records, read and write record comments, list accessible bases, and receive real-time base change events through webhooks.

Sentry

Track, manage, and resolve application errors and performance issues. List, query, and bulk-update issues and error events with filters like status, assignment, and tags. Create and manage releases, associate commits, and upload source maps. Configure issue alert rules and metric alert rules with notification actions. Set up cron monitors to detect missed or failed scheduled jobs. Build custom dashboards with configurable widgets. Run ad-hoc Discover queries across errors and transactions for performance analysis. Manage organizations, teams, projects, and members. Provision users via SCIM. Access session replay data.

Bitbucket

Manage Git repositories, pull requests, and CI/CD pipelines on Bitbucket Cloud. Create, fork, and configure repositories within workspaces and projects. Create, review, approve, merge, and decline pull requests with inline code comments. Browse source code, list commits, and manage branches and tags. Trigger, monitor, and manage Bitbucket Pipelines. List workspace members, configure repository default reviewers and branch restrictions, create and manage repository webhooks, and search code across repositories.

Technical notes for Scrapegraph Ai

Extract structured data from webpages using natural language prompts and AI. Scrape single pages or crawl entire websites with configurable depth and rules. Perform AI-powered web searches across multiple sources with structured results. Convert webpages to clean Markdown. Fetch raw HTML with JavaScript rendering. Automate browser interactions (clicking, typing, form filling, logging in) before extracting data. Discover website sitemaps. Supports custom output schemas, stealth mode, proxy routing, geo-targeting, and webhook notifications for crawl job completion. Check API credit balance and retrieve past request history.

Frequently asked questions

Common questions about connecting Scrapegraph Ai to AI agents with Metorial.

  1. How many tools does the Scrapegraph Ai MCP server have?
    The Scrapegraph Ai MCP server exposes 12 tools, including Convert to Markdown, Get Credits, Crawl Website. Each one is governed and traced through Metorial.
  2. Scrapegraph Ai exposes tools your agents call on demand; it does not publish event triggers yet. Everything still runs through one governed MCP URL.
  3. Any MCP client, including VS Code, Windsurf, Zed, OpenCode and Grok. Each one reaches the Scrapegraph Ai MCP server through the same Metorial URL.
  4. Use role-based access control to decide which teams, users, and agents can use Scrapegraph Ai and which of its tools they can call.
  5. Yes. Metorial is open source, so you can run the Scrapegraph Ai MCP server yourself or use the hosted gateway.

Connect Scrapegraph Ai to production AI agents

See how Metorial gives your team governed access to Scrapegraph Ai, with tracing and security controls built in.