Connect Scrapegraph Ai to Claude, ChatGPT, Cursor, Claude Code, Codex, Gemini, GitHub Copilot and any other MCP client, for your whole team. Metorial adds security, governance, and tracing, and gives everyone one Magic MCP URL to connect.
What you can do with the Scrapegraph Ai MCP server
Ask your agent in plain language. Each of these maps to a real tool on the server.
Use the convert to markdown tool in Scrapegraph Ai
Use the get credits tool in Scrapegraph Ai
Use the crawl website tool in Scrapegraph Ai
Use the get request status tool in Scrapegraph Ai
Use the discover sitemap tool in Scrapegraph Ai
Use the web search tool in Scrapegraph Ai
Supported Tools
markdownify
Convert to Markdown
Uses the legacy v1 API and requires a compatible legacy API key. Converts a webpage into clean, well-formatted Markdown. Strips ads, navigation, and irrelevant elements while preserving content structure, images, and links.
Useful for preparing web content for LLMs, documentation, or content migration.
get_credits
Get Credits
Uses the legacy v1 API and requires a compatible legacy API key. Retrieves the current API credit balance and total credits used for the account.
crawl_website
Crawl Website
Uses the legacy v1 API and requires a compatible legacy API key. Crawls multiple pages of a website starting from a given URL, following links with configurable depth and breadth.
Two modes: **AI extraction** (structured output with a prompt) and **markdown conversion** (no AI, lower cost). Supports crawl rules for include/exclude paths, sitemap-based discovery, and webhook notifications on completion.
get_request_status
Get Request Status
Uses the legacy v1 API and requires a compatible legacy API key. Retrieves the status and results of a previous scraping request by its request ID. Supports all service types: smartscraper, searchscraper, markdownify, scrape, crawl, sitemap, and agentic-scrapper.
discover_sitemap
Discover Sitemap
Uses the legacy v1 API and requires a compatible legacy API key. Extracts and returns the sitemap structure of a website by discovering URLs from sitemap.xml, robots.txt, and common sitemap locations.
Useful for understanding site organization, URL discovery, and SEO audits before performing a larger crawl.
web_search
Web Search
Uses the legacy v1 API and requires a compatible legacy API key. Performs AI-powered web searches using a natural language prompt and aggregates structured results from multiple web sources with source attribution.
Two modes: **AI Extraction** (structured data, higher cost) and **Markdown Mode** (raw content, lower cost). Supports geo-targeted search and time range filtering.
raw_scrape
Fetch Raw HTML
Uses the legacy v1 API and requires a compatible legacy API key. Fetches and returns the raw HTML of a webpage with JavaScript rendering support. Useful when you need the complete page source rather than AI-processed output.
Optionally extracts branding information (colors, fonts, typography, UI styles, metadata).
agentic_scrape
Agentic Scrape
Uses the legacy v1 API and requires a compatible legacy API key. Automates browser interactions using a sequence of natural language steps before extracting data. Can click buttons, fill forms, type text, scroll, navigate, and log in to websites.
Supports session persistence for multi-step workflows and optional AI extraction with schema support. Without AI extraction, returns raw markdown.
smart_scrape
Smart Scrape
Uses the legacy v1 API and requires a compatible legacy API key. Extracts structured data from a single webpage using AI and a natural language prompt. Provide a URL (or raw HTML/Markdown content) and describe what data you want extracted; returns structured JSON.
Supports custom output schemas for consistent data structure, infinite scroll handling, stealth mode for anti-detection, and proxy routing by country.
generate_schema
Generate Extraction Schema
Generate a JSON schema from a natural language description, or extend an existing schema with additional fields, using the current ScrapeGraphAI API.
extract_data
Extract Structured Data
Extract structured data from a webpage, HTML, or Markdown using the current ScrapeGraphAI API and a natural language prompt. Optionally constrain the result with a JSON schema.
list_history
List Request History
List recent requests from the current ScrapeGraphAI API, newest first, with identifiers, status, timing, errors, and pagination. Filter by service or workflow session.
Enable Scrapegraph Ai in Metorial. In your Metorial portal, enable the Scrapegraph Ai MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add a custom connector. Open Customize, then Connectors. Select Add, then Custom, then Web.
Paste your Metorial MCP URL. Name it Metorial, paste your Magic MCP URL (<your-magic-mcp-url>) and continue.
Sign in. Select Add and sign in to load Scrapegraph Ai tools.
Enable Scrapegraph Ai in Metorial. In your Metorial portal, enable the Scrapegraph Ai MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add a custom MCP server. On ChatGPT web, open Plugins, select +, then Add custom MCP server.
Paste your Metorial MCP URL. Name it Metorial, paste your Magic MCP URL (<your-magic-mcp-url>), choose OAuth and accept the risk notice.
Create and install the plugin. Select Create as a plugin, install it and sign in to load Scrapegraph Ai tools.
Enable Scrapegraph Ai in Metorial. In your Metorial portal, enable the Scrapegraph Ai MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add Metorial to your MCP config. Use ~/.cursor/mcp.json for every project, or .cursor/mcp.json for one.
Sign in. Open Customize in the sidebar, find Metorial and sign in to load Scrapegraph Ai tools.
{
"mcpServers":{
"metorial":{
"url":"<your-magic-mcp-url>"
}
}
}
Enable Scrapegraph Ai in Metorial. In your Metorial portal, enable the Scrapegraph Ai MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add the server over HTTP. Add --scope user to use it in every project.
Sign in. Run /mcp, select Metorial and sign in to load Scrapegraph Ai tools.
claude mcp add --transport http metorial <your-magic-mcp-url>
Enable Scrapegraph Ai in Metorial. In your Metorial portal, enable the Scrapegraph Ai MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add the server and sign in. The Codex CLI, IDE extension and ChatGPT desktop app share this config.
Check the connection. Type /mcp in Codex to see Metorial and its Scrapegraph Ai tools.
codex mcp add metorial --url <your-magic-mcp-url>
codex mcp login metorial
Run Scrapegraph Ai through the Metorial gateway
One governed layer for every app your agents reach, not a separate connector per tool.
Give Scrapegraph Ai and every other app to your whole team through one MCP gateway, behind your SSO.
Scope which teams and agents can use Scrapegraph Ai tools with role-based access control, and trace every call.
Prefer to run it yourself? Metorial is open source and self-hostable.
Extract structured data from webpages using natural language prompts and AI. Scrape single pages or crawl entire websites with configurable depth and rules. Perform AI-powered web searches across multiple sources with structured results. Convert webpages to clean Markdown. Fetch raw HTML with JavaScript rendering. Automate browser interactions (clicking, typing, form filling, logging in) before extracting data. Discover website sitemaps. Supports custom output schemas, stealth mode, proxy routing, geo-targeting, and webhook notifications for crawl job completion. Check API credit balance and retrieve past request history.
Frequently asked questions
Common questions about connecting Scrapegraph Ai to AI agents with Metorial.
How many tools does the Scrapegraph Ai MCP server have?
The Scrapegraph Ai MCP server exposes 12 tools, including Convert to Markdown, Get Credits, Crawl Website. Each one is governed and traced through Metorial.
Does the Scrapegraph Ai MCP server support triggers?
Scrapegraph Ai exposes tools your agents call on demand; it does not publish event triggers yet. Everything still runs through one governed MCP URL.
Which AI clients can use the Scrapegraph Ai MCP server?
Any MCP client, including VS Code, Windsurf, Zed, OpenCode and Grok. Each one reaches the Scrapegraph Ai MCP server through the same Metorial URL.
How do I give only some teams access to Scrapegraph Ai?
Use role-based access control to decide which teams, users, and agents can use Scrapegraph Ai and which of its tools they can call.
Can I self-host the Scrapegraph Ai MCP server?
Yes. Metorial is open source, so you can run the Scrapegraph Ai MCP server yourself or use the hosted gateway.
Connect Scrapegraph Ai to production AI agents
See how Metorial gives your team governed access to Scrapegraph Ai, with tracing and security controls built in.