Connect Scrapingant to Claude, ChatGPT, Cursor, Claude Code, Codex, Gemini, GitHub Copilot and any other MCP client, for your whole team. Metorial adds security, governance, and tracing, and gives everyone one Magic MCP URL to connect.
Ask your agent in plain language. Each of these maps to a real tool on the server.
Use the scrape extended tool in Scrapingant
Use the scrape as markdown tool in Scrapingant
Use the check usage tool in Scrapingant
Use the scrape webpage tool in Scrapingant
Use the extract structured data tool in Scrapingant
Use the download markdown tool in Scrapingant
Supported Tools
scrape_extended
Scrape Extended
Scrape a web page and return extended JSON output including HTML, plain text, cookies, response status code, headers, XHR requests, and iframes.
Use this when you need more than just the page HTML — such as inspecting API calls made by the page (XHRs), reading response cookies/headers, or extracting iframe content.
scrape_as_markdown
Scrape as Markdown
Scrape a web page and return its content converted to Markdown format. Ideal for feeding web content into LLMs, RAG systems, or any text-processing pipeline.
Supports the same browser rendering, proxy, and interaction options as standard scraping.
check_usage
Check Usage
Check the current API credit usage and subscription status for your ScrapingAnt account. Returns plan details, remaining credits, and subscription period.
scrape_webpage
Scrape Webpage
Scrape a web page and return its rendered HTML content. ScrapingAnt handles JavaScript rendering, anti-bot bypass (CAPTCHA, Cloudflare), and proxy rotation automatically.
Use this to retrieve the full HTML of any webpage, optionally with custom browser settings, proxy configuration, or JavaScript execution.
extract_data
Extract Structured Data
Extract structured data from a web page using AI. Provide a free-form description of the data fields you want, and the AI model will extract them into a JSON object with camelCase property names.
Useful for extracting product info, article content, pricing, reviews, or any structured data from a webpage without writing custom parsers.
download_markdown
Download Markdown
Scrape a web page and save its converted content as a downloadable Markdown file for archiving or a document-processing workflow.
Enable Scrapingant in Metorial. In your Metorial portal, enable the Scrapingant MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add a custom connector. Open Customize, then Connectors. Select Add, then Custom, then Web.
Paste your Metorial MCP URL. Name it Metorial, paste your Magic MCP URL (<your-magic-mcp-url>) and continue.
Sign in. Select Add and sign in to load Scrapingant tools.
Enable Scrapingant in Metorial. In your Metorial portal, enable the Scrapingant MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add a custom MCP server. On ChatGPT web, open Plugins, select +, then Add custom MCP server.
Paste your Metorial MCP URL. Name it Metorial, paste your Magic MCP URL (<your-magic-mcp-url>), choose OAuth and accept the risk notice.
Create and install the plugin. Select Create as a plugin, install it and sign in to load Scrapingant tools.
Enable Scrapingant in Metorial. In your Metorial portal, enable the Scrapingant MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add Metorial to your MCP config. Use ~/.cursor/mcp.json for every project, or .cursor/mcp.json for one.
Sign in. Open Customize in the sidebar, find Metorial and sign in to load Scrapingant tools.
{
"mcpServers":{
"metorial":{
"url":"<your-magic-mcp-url>"
}
}
}
Enable Scrapingant in Metorial. In your Metorial portal, enable the Scrapingant MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add the server over HTTP. Add --scope user to use it in every project.
Sign in. Run /mcp, select Metorial and sign in to load Scrapingant tools.
claude mcp add --transport http metorial <your-magic-mcp-url>
Enable Scrapingant in Metorial. In your Metorial portal, enable the Scrapingant MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add the server and sign in. The Codex CLI, IDE extension and ChatGPT desktop app share this config.
Check the connection. Type /mcp in Codex to see Metorial and its Scrapingant tools.
codex mcp add metorial --url <your-magic-mcp-url>
codex mcp login metorial
Run Scrapingant through the Metorial gateway
One governed layer for every app your agents reach, not a separate connector per tool.
Give Scrapingant and every other app to your whole team through one MCP gateway, behind your SSO.
Scope which teams and agents can use Scrapingant tools with role-based access control, and trace every call.
Prefer to run it yourself? Metorial is open source and self-hostable.
Scrape web pages and extract data from websites using headless Chrome browsers with automatic proxy rotation, CAPTCHA bypass, and Cloudflare handling. Render JavaScript-heavy pages, execute custom JS snippets, and wait for specific page elements. Convert scraped HTML to Markdown for LLM/RAG use cases. Extract structured data using AI-powered extraction with free-form field descriptions. Configure proxy geo-targeting, block specific resource types, pass custom cookies and headers, and retrieve extended response data including cookies, headers, and XHR details. Check API credit usage and subscription status.
Frequently asked questions
Common questions about connecting Scrapingant to AI agents with Metorial.
How many tools does the Scrapingant MCP server have?
The Scrapingant MCP server exposes 6 tools, including Scrape Extended, Scrape as Markdown, Check Usage. Each one is governed and traced through Metorial.
Does the Scrapingant MCP server support triggers?
Scrapingant exposes tools your agents call on demand; it does not publish event triggers yet. Everything still runs through one governed MCP URL.
Which AI clients can use the Scrapingant MCP server?
Any MCP client, including VS Code, Windsurf, Zed, OpenCode and Grok. Each one reaches the Scrapingant MCP server through the same Metorial URL.
How do I give only some teams access to Scrapingant?
Use role-based access control to decide which teams, users, and agents can use Scrapingant and which of its tools they can call.
Can I self-host the Scrapingant MCP server?
Yes. Metorial is open source, so you can run the Scrapingant MCP server yourself or use the hosted gateway.
Connect Scrapingant to production AI agents
See how Metorial gives your team governed access to Scrapingant, with tracing and security controls built in.