Connect Metorial Crawl to Claude, ChatGPT, Cursor, Claude Code, Codex, Gemini, GitHub Copilot and any other MCP client, for your whole team. Metorial adds security, governance, and tracing, and gives everyone one Magic MCP URL to connect.
What you can do with the Metorial Crawl MCP server
Ask your agent in plain language. Each of these maps to a real tool on the server.
Use the extract web content tool in Metorial Crawl
Compile Competitive Intelligence Reports Using Web Research
Legal Document Search and Matter Research Across SharePoint
Research and Qualify Inbound Leads Before Adding to Salesforce
Supported Tools
extractWebContent
Extract Web Content
Extract the main content and outgoing links from a page. Use this when you want focused crawling/extraction behavior rather than search-oriented browsing.
Enable Metorial Crawl in Metorial. In your Metorial portal, enable the Metorial Crawl MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add a custom connector. Open Customize, then Connectors. Select Add, then Custom, then Web.
Paste your Metorial MCP URL. Name it Metorial, paste your Magic MCP URL (<your-magic-mcp-url>) and continue.
Sign in. Select Add and sign in to load Metorial Crawl tools.
Enable Metorial Crawl in Metorial. In your Metorial portal, enable the Metorial Crawl MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add a custom MCP server. On ChatGPT web, open Plugins, select +, then Add custom MCP server.
Paste your Metorial MCP URL. Name it Metorial, paste your Magic MCP URL (<your-magic-mcp-url>), choose OAuth and accept the risk notice.
Create and install the plugin. Select Create as a plugin, install it and sign in to load Metorial Crawl tools.
Enable Metorial Crawl in Metorial. In your Metorial portal, enable the Metorial Crawl MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add Metorial to your MCP config. Use ~/.cursor/mcp.json for every project, or .cursor/mcp.json for one.
Sign in. Open Customize in the sidebar, find Metorial and sign in to load Metorial Crawl tools.
{
"mcpServers":{
"metorial":{
"url":"<your-magic-mcp-url>"
}
}
}
Enable Metorial Crawl in Metorial. In your Metorial portal, enable the Metorial Crawl MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add the server over HTTP. Add --scope user to use it in every project.
Sign in. Run /mcp, select Metorial and sign in to load Metorial Crawl tools.
claude mcp add --transport http metorial <your-magic-mcp-url>
Enable Metorial Crawl in Metorial. In your Metorial portal, enable the Metorial Crawl MCP server and sign in with the account that owns the data. Access stays governed by your team policies.
Add the server and sign in. The Codex CLI, IDE extension and ChatGPT desktop app share this config.
Check the connection. Type /mcp in Codex to see Metorial and its Metorial Crawl tools.
codex mcp add metorial --url <your-magic-mcp-url>
codex mcp login metorial
Run Metorial Crawl through the Metorial gateway
One governed layer for every app your agents reach, not a separate connector per tool.
Give Metorial Crawl and every other app to your whole team through one MCP gateway, behind your SSO.
Scope which teams and agents can use Metorial Crawl tools with role-based access control, and trace every call.
Prefer to run it yourself? Metorial is open source and self-hostable.