Web Search integrations on Metorial

Hacker News

Read and search Hacker News content including stories, comments, jobs, polls, and user profiles. Retrieve curated story listings such as top, new, best, Ask HN, Show HN, and job stories. Look up user profiles with karma, submission history, and bios. Perform full-text search across all content with filtering by type, author, date range, and point thresholds. Track recently changed items and profiles via the updates feed. Subscribe to real-time changes on items, story rankings, and profiles via Firebase listeners. All access is read-only with no authentication required.

Dataforseo

Retrieve practical DataForSEO API v3 data for SEO, SEM, ecommerce, business listings, Google Play apps, content analysis, and AI optimization. Supports Google/Bing/Yahoo/YouTube organic SERP live search, Google Ads keyword metrics, DataForSEO Labs keyword and domain intelligence, backlinks, OnPage audits and results, domain analytics, Google Shopping and Amazon Merchant tasks, Business Listings and Google Reviews, Google Play App Data tasks, and AI keyword, LLM mentions, and live LLM response benchmarking.

Firecrawl

Scrape, crawl, search, map, parse, monitor, and extract data from websites and files with Firecrawl v2. Convert pages into markdown, HTML, screenshots, links, summaries, structured JSON, answers, highlights, and media URLs with browser automation, batch jobs, agent jobs, browser sandbox sessions, content monitors, and account usage visibility.

Webscrapingai

Scrape and extract data from any website with automatic proxy rotation, headless browser rendering, CAPTCHA solving, and retries. Fetch full rendered HTML or plain text from web pages. Extract specific page elements using CSS selectors. Ask natural language questions about webpage content and receive AI-generated answers. Extract structured JSON fields from pages using AI-powered field descriptions. Execute custom JavaScript on loaded pages to interact with dynamic content. Emulate desktop, mobile, or tablet devices. Route requests through datacenter or residential proxies with geo-targeting support. Send custom headers and cookies for authenticated scraping. Check account credit balance and usage limits.

Exa

Search the web using AI-native neural and keyword search methods. Extract full text, highlights, and summaries from web pages. Find similar pages based on a given URL. Get AI-generated answers to questions with citations. Automate in-depth web research and receive structured results with citations. Build and manage Websets—structured collections of web entities found, verified, and enriched by search agents. Import data into Websets, enrich items with additional structured data, schedule monitors for continuous updates, and export results to CSV, JSON, or XLSX. Configure webhooks for Webset lifecycle events.

Anthropic

Generate text and analyze images using Claude language models. Send conversational messages with configurable parameters (model, temperature, system prompt) and receive AI-generated responses, with optional streaming. Execute Python code in a sandboxed environment for data analysis and visualizations. Perform web searches for up-to-date information with cited sources. Use tool calling (function calling) to let Claude invoke structured tools during conversations. Enable extended thinking for complex reasoning tasks. Process and analyze images via vision capabilities. Upload and manage files for multi-session analysis. Connect to remote MCP servers for external system integration. Use agent skills for working with PowerPoint, Excel, Word, and PDF files. Count tokens, cache prompts for reduced latency and cost, create message batches for async processing, and enable citations for source attribution. Administer organizations by managing members, workspaces, invites, API keys, and retrieving usage and cost reports.

Parallel

Perform AI-optimized web searches, extract content from URLs, run deep multi-step research tasks, and discover entities matching natural language criteria. Provides web-grounded chat completions compatible with OpenAI client libraries. Continuously monitor the web for new information on a configurable schedule and receive webhook notifications when relevant changes are detected. Supports structured JSON output schemas, multiple processing tiers for cost/thoroughness trade-offs, and asynchronous task execution with polling or webhook-based completion tracking.

Aiml API

Unified gateway to 400+ AI/ML models for text generation, image generation, video generation, music generation, speech-to-text, text-to-speech, content moderation, 3D model generation, vision/OCR, embeddings, and AI-powered web search. Generate chat completions and reasoning with models like GPT, Claude, Gemini, DeepSeek, and Llama. Create images from text prompts using Flux, Stable Diffusion, and DALL-E. Generate videos from text or images asynchronously. Convert speech to text and text to speech in 120+ languages. Moderate content for safety classification. Generate 3D objects from text or images. Extract text and structured data from images via OCR. Produce text embeddings for semantic search. Search the web for real-time information. Create AI Assistants for customer support and data analysis. Interact in real time via WebSocket for voice and text. Receive webhook notifications for async operation completion.

Ahrefs

Access Ahrefs SEO data including backlink analysis, keyword research, organic traffic estimates, and SERP analysis. Analyze any domain or URL to retrieve Domain Rating, referring domains, organic traffic, top pages, and anchor text distribution. Research keywords with difficulty scores, search volumes, click metrics, and related suggestions. Retrieve current SERP data for competitive analysis. Monitor keyword ranking positions over time and manage Rank Tracker projects. Access Site Audit data including crawl results, detected issues, and health scores. Monitor brand appearances in AI-generated responses across AI platforms via Brand Radar. Manage Keywords Explorer lists and Rank Tracker projects programmatically.

Algolia

Search, index, and manage records and indices using Algolia's hosted search platform. Perform full-text search with typo tolerance, faceting, filtering, geo-search, and multi-language support. Configure index settings, searchable attributes, custom ranking, synonyms, and query rules. Track user events (clicks, conversions, views, purchases) to power analytics, personalization, and recommendations. Run A/B tests on index configurations. Generate product recommendations including related products, frequently bought together, and trending items. Manage API keys with fine-grained permissions and restrictions. Set up automated data ingestion pipelines from external sources. Crawl websites to extract and index content. Monitor infrastructure status, latency, and indexing performance.

Apiflash

Capture screenshots of any publicly accessible URL using a Chrome-based rendering engine. Configure viewport dimensions, capture full-page scrollable content, or target specific HTML elements via CSS selectors. Supports PNG, JPEG, and WebP output formats. Inject custom CSS and JavaScript to modify page appearance before capture. Pass custom headers, cookies, and proxies to access authenticated or geo-restricted pages. Hide cookie banners automatically. Export screenshots directly to Amazon S3 buckets. Control caching behavior and force fresh captures. Extract HTML content from target pages. Monitor API quota usage and remaining credits.

Apipie Ai

Access hundreds of AI models from multiple providers (OpenAI, Anthropic, Google, Meta, etc.) through a unified OpenAI-compatible API. Send chat completions to language models with streaming, function calling, and structured output. Generate images, convert text to speech, analyze images with vision models, and create text embeddings. Augment responses with real-time web search grounding, upload documents for RAG-based retrieval, and reduce hallucinations via integrity checking. Discover and filter available models by type, provider, pricing, and performance. Manage routing preferences (cost or performance optimized), configure model pooling for redundancy, enable persistent conversational memory, and track API usage with detailed cost and token analytics.

Bright Data

Scrape websites, bypass anti-bot protections, and extract structured data at scale. Unlock blocked web pages with automatic CAPTCHA solving and proxy rotation. Query search engines (Google, Bing, Yandex, DuckDuckGo) for SERP data with localization and device emulation. Run 120+ pre-built scrapers for popular platforms like Amazon, LinkedIn, and Airbnb. Crawl millions of pages simultaneously. Automate headless browsers via Puppeteer, Playwright, or Selenium with built-in anti-detection. Access pre-collected datasets from 100+ domains. Manage proxy networks across 195 countries with residential, datacenter, ISP, and mobile IPs. Configure zones, manage account settings, and receive webhook notifications on job completion.

Browseai

Run and manage no-code web scraping robots to extract structured data from websites. Execute on-demand scraping tasks with custom input parameters, retrieve extracted data as structured key-value pairs, and schedule automated monitoring to detect changes on web pages. Perform bulk data extraction across many pages, manage robot cookies for authenticated sessions, and configure webhooks for task completion, data change detection, and export events.

Browserbase

Create and manage cloud-hosted headless browser sessions for web automation. Configure sessions with proxy settings, regional selection, timeouts, and stealth mode for anti-detection. Persist browser state (cookies, localStorage, authentication tokens) across sessions using contexts. Upload Chrome extensions and files to sessions, and retrieve downloaded files. Monitor and debug sessions via CDP logs, session recordings, and live debugger URLs. Retrieve project usage data including browser minutes and proxy bytes consumed.

Currents API

Search and retrieve global news articles from over 14,000 sources across 70 countries and 18 languages. Fetch latest news in real time, search historical articles by keywords, date range, language, country, category, and domain. Discover available news sources and filter by language or category. Analyze topic trends and sentiment over time. Access reference data for supported languages, regions, and categories.

Decodo

Scrape and extract structured data from websites using 100+ pre-built templates for eCommerce, search engines, and social media platforms. Route web requests through residential, mobile, ISP, and datacenter proxy pools across 195+ geo-locations. Manage proxy users, whitelisted IPs, and traffic limits via the Public API. Supports real-time and asynchronous scraping with configurable JavaScript rendering, CAPTCHA solving, device emulation, and output parsing (JSON, HTML, Markdown, screenshots). Schedule recurring scrape jobs with delivery via email, webhook, or Google Drive. Track traffic usage, request success rates, and spend across all proxy products. Receive webhook notifications for payment failures, usage threshold alerts, subscription events, and account status changes.

Diffbot

Extract structured data from web pages using AI-powered computer vision and NLP. Automatically classify and parse articles, products, events, jobs, discussions, images, and videos into clean JSON. Search a knowledge graph of 10+ billion entities (organizations, people, articles, products) using Diffbot Query Language (DQL). Enrich person and organization records from minimal identifiers. Analyze natural language text to extract entities, facts, sentiment, and relationships. Crawl entire websites or process bulk URL lists through extraction APIs. Define custom extraction rules with CSS selectors for specific domains. Receive webhook notifications when crawl or bulk jobs complete.

Wachete

Monitor web page content for changes and receive notifications when updates occur. Create and manage monitors (wachets) for single pages or entire portals with configurable crawling depth. Track specific page sections using XPath selectors, enable JavaScript rendering for dynamic content, and monitor password-protected pages and documents (PDF, DOC). Configure alert conditions, notification channels (email, webhook), and monitoring frequency. Retrieve change history with diff output, browse notifications filtered by date range, and organize monitors into folders.

Webscraper Io

Create, manage, and execute web scraping jobs to extract structured data from websites. Define sitemaps with CSS selectors and start URLs, run scraping jobs with configurable drivers (fast or full JavaScript), proxies, and timing controls. Monitor job status and data quality, download scraped data in JSON or CSV format, and schedule recurring scraping jobs using cron expressions. Receive webhook notifications when scraping jobs complete. Retrieve account information and remaining page credits.

World News API

Search, retrieve, and analyze news articles from thousands of sources across 210+ countries and 86+ languages. Filter news by keywords, date, location, category, language, sentiment, and source. Retrieve top/breaking news headlines clustered by story importance. Extract structured article data from any URL. Discover news sources by name, country, or language. Look up newspaper front page images. Convert news websites to RSS feeds. Perform geo-located news searches by coordinates and radius. Access sentiment scores for articles.

Writer

Generate text and chat completions using Writer's Palmyra family of large language models. Create and manage Knowledge Graphs for RAG-based question answering with inline citations. Upload, list, retrieve, and delete files for use with Knowledge Graphs and agents. Analyze images via vision capabilities. Perform web searches for real-time information retrieval. Invoke no-code AI agents as microservices for text generation and research tasks. Use tool calling to integrate custom functions, Knowledge Graph queries, vision, translation, model delegation, and web search within chat conversations. Parse PDFs to extract structured content. Configure guardrails for content safety including toxic content detection and PII protection.

Yelp

Search for local businesses by keyword, category, location, phone number, price level, and transaction type. Retrieve detailed business information including name, address, phone, photos, ratings, hours, and price levels. Access review excerpts and review highlights for businesses. Provide real-time autocomplete suggestions for business, term, and category searches. Match businesses by name and address to obtain Yelp Business IDs. Use conversational AI chat for natural language local business discovery. Manage business listings, respond to reviews, handle leads, book reservations, and manage advertising programs via partner APIs. Retrieve engagement metrics, advertising performance data, and location analytics. Subscribe to webhooks for review and lead event notifications.

Zenrows

Scrape and extract data from public websites. Fetch page content from any URL with JavaScript rendering, anti-bot bypass, CAPTCHA solving, and premium proxy rotation. Extract structured data using CSS selectors or auto-parsing. Capture screenshots, render pages as Markdown, plain text, or PDF. Target requests from 190+ countries using geolocation. Scrape structured product data from e-commerce platforms like Amazon and Walmart, real estate listings from Zillow and Idealista, and Google search results. Supports session management, device emulation, custom headers, and JavaScript instructions for page interaction.

Zenserp

Scrape and retrieve structured search engine results from Google, Bing, Yandex, and DuckDuckGo in real time. Perform web searches with geotargeting, language, and result count filters. Search Google Images with size, color, and type filters, and perform reverse image lookups. Retrieve Google News, Shopping, Maps/local business, and YouTube search results. Scrape Google Trends data including keyword popularity over time, geographic breakdowns, and related topics. Look up shopping product details by product ID. Retrieve keyword search volume and CPC data. Check account status and remaining API request quota.

Foursquare

Search, discover, and retrieve detailed information about places and venues from a global database of 100M+ points of interest across 200+ countries. Search places by keyword, category, chain, or geographic area with autocomplete support. Retrieve rich place details including addresses, coordinates, categories, hours, photos, reviews, ratings, and popularity. Match and enrich POI data using GeoTagging/Place Match. Propose edits and flag issues with place data. Manage geofences around venues, coordinates, or custom polygons with bulk operations. Provide personalized place recommendations based on user taste and visit history. Upload and manage geospatial datasets in Foursquare Studio. Access measurement data for campaign insights and optimization. Manage users and authentication tokens. Receive real-time webhook pushes for user check-ins and venue activity.

Geokeo

Convert addresses and place names into geographic coordinates (forward geocoding) and convert latitude/longitude coordinates into human-readable addresses (reverse geocoding). Filter results by country using ISO country codes. Retrieve bounding box coordinates, formatted postal addresses, and distance calculations. Supports JSON and XML response formats with built-in spell check for improved accuracy.

Giphy

Search, discover, and retrieve GIFs, stickers, animated emoji, and video clips from GIPHY's library of millions of items. Upload GIF and video content to GIPHY channels. Get trending GIFs and stickers, translate words and phrases into matching GIFs, fetch random GIFs, and retrieve content by ID. Access search discovery tools including trending searches, search suggestions, autocomplete, and content categories. Register analytics events for user interactions (views, clicks, sends). Filter results by content rating and language.

Google Search Console

Query search traffic analytics including clicks, impressions, CTR, and average position, with filtering by query, page, country, device, search type, and date. Manage Search Console site properties by adding, removing, and listing sites. Submit, list, retrieve, and delete sitemaps. Inspect URLs to check indexing status, AMP results, rich results, and mobile usability. Run mobile-friendly tests on URLs to check Google's mobile-friendliness standards.

Hyperbrowser

Manage cloud-based headless browser sessions for AI agents and web automation. Create, configure, and stop browser sessions with built-in stealth mode, proxy rotation, CAPTCHA solving, and anti-bot detection. Scrape web pages in markdown or HTML, crawl entire websites, and extract structured data using AI-powered schema-based extraction. Run autonomous AI browser agents (Browser Use, Claude Computer Use, OpenAI CUA, Gemini) that accept natural language tasks and operate a browser to complete them. Manage persistent browser profiles to maintain login state and cookies across sessions. Upload and attach Chrome extensions, retrieve downloaded files, perform web searches via Bing, capture session recordings, and observe live browser sessions in real-time.

Hystruct

Extract structured data from websites using AI-powered web scraping. Create and trigger scraping jobs for existing workflows, retrieve extracted data shaped by user-defined schemas, and manage webhook subscriptions for real-time event notifications. Supports multi-page scraping (loops) for listing pages, schema-based extraction with field types like String, Number, Boolean, Date, and Array, and asynchronous job processing for crawling sub-pages.

Ip 2 Whois

Look up domain WHOIS records to retrieve registration and ownership information including creation date, expiration date, domain age, registrant contact details, nameservers, and more. Find hosted domains by IP address (IPv4 and IPv6). Convert internationalized domain names to/from punycode, extract domain names from URLs, and identify gTLD or ccTLD extensions. Supports 1221 TLDs and 634 ccTLDs.

Kadoa

Extract, transform, and deliver structured data from websites, PDFs, and documents using AI-powered web scraping. Create and manage data extraction workflows targeting single or multiple URLs with configurable schedules. Define reusable data schemas and templates for consistent extraction across sites. Perform ad-hoc extractions from single webpages without persistent workflows. Crawl website subpages and convert them to structured JSON or markdown. Monitor web sources for data changes and receive alerts for updates. Validate extracted data quality with configurable rules. Export data in CSV or JSON, or deliver directly to S3, Snowflake, Google Sheets, and other integrations. Subscribe to webhook events for workflow completion and data change notifications.

Keyword

Track keyword rankings across Google SERP and AI search platforms. Create and manage tracking projects, monitor keyword positions by location and device type, and retrieve historical SERP data. Analyze share of voice, competitor visibility, search volume, and search intent. Track brand visibility across AI platforms including ChatGPT, Perplexity, AI Mode, and Gemini. Export ranking data and generate shareable performance reports.

Linkup

Search the web using natural language queries and retrieve real-time content for AI grounding. Perform standard fast searches or deep iterative searches for comprehensive results. Get sourced answers with citations, raw search result chunks, or structured data extraction following a custom JSON schema. Filter results by date range, specific domains, and result count. Fetch and extract clean markdown content from individual web pages, optionally rendering JavaScript for dynamic sites. Check account credit balance.

Listen Notes

Search, browse, and retrieve metadata for millions of podcasts and episodes. Perform full-text search across episode titles, descriptions, and podcast metadata with filters for language, genre, region, and publish date. Fetch detailed podcast and episode information including titles, descriptions, audio URLs, images, and cross-platform links (Spotify, Apple Podcasts, YouTube). Discover trending and recommended podcasts, browse curated "best podcasts" lists by genre, and find similar shows. Retrieve episode transcripts where available. Manage playlists of podcasts and episodes. Submit new podcast RSS feeds to the database. Look up podcasts by Apple Podcasts/iTunes IDs for cross-platform matching. Browse the full taxonomy of podcast genres and supported languages.

Newsdata Io

Search and retrieve current and historic news articles from over 150,000 worldwide sources. Perform keyword searches across hundreds of millions of articles with advanced filtering by source, domain, date range, language, and country. Get live top and breaking headlines by country, category (business, entertainment, general, health, science, sports, technology), or specific sources. Discover and list available news publishers and their metadata. Sort results by relevancy, popularity, or publication date. Supports 14 languages and 55 countries.

Opencage

Convert addresses and place names to geographic coordinates (forward geocoding) and coordinates to addresses (reverse geocoding) using open data worldwide. Retrieve location annotations including timezone, currency, sunrise/sunset times, driving side, road info, and alternative coordinate formats (geohash, what3words, Maidenhead, Mercator). Filter results by country code, bounding box, proximity, language, and confidence level. Perform autosuggest/geosearch for type-ahead location lookups. Batch geocode spreadsheets and CSV files. Supports JSON, GeoJSON, and XML output formats.

Openperplex

Perform AI-powered web searches with LLM-generated answers, sources, and citations. Search the web with customizable models, locations, languages, and recency filters. Execute custom searches with tailored system prompts for summarization, analysis, or structured extraction. Stream search results incrementally in real time. Query URL content by asking questions about a specific web page. Extract web page content as plain text or Markdown. Capture live screenshots of any web page.