All projects matching “scrape”

Web page scrape: one URL fetched and rendered by Firecrawl (headless browser), returned as markdown, html, rawHtml and/or links. Not charged when the page cannot be fetched.

Firecrawl v2 API proxy — scrape. JSON body matches https://docs.firecrawl.dev/api-reference/v2-introduction. Poll GET routes are free; POST/PUT/DELETE are x402. $0.042 USDC per request. Agent search: scrape, markdown, firecrawl, web scrape, scrape-lite.

Scrapes a URL and returns structured JSON: title, meta tags, headings, paragraphs, links, tables, extracted emails and phone numbers, and word counts. Accepts a single 'url' or a list of 'urls' for batch scraping. Includes retry logic and anti-detection headers.

Payload Check: data-quality filter for agents. Send any payload (tool/API output, scraped page, LLM answer, generated code, JSON, CSV) and get a 0-100 quality score, pass/warn/fail, tags and concrete issues: invalid or truncated JSON (with auto-repair), JSON Schema mismatches, syntax errors, bot-challenge/captcha/404 scrapes, LLM refusals, placeholders, repetition loops, mojibake. Deterministic, n

Page to JSON: scrape and extract any public web page URL into clean structured data JSON. Web scraper / HTML-to-JSON extractor / readability parser for AI agents and LLMs: returns title, author, site name, published date, main article text (plain text), word count, up to 200 links and an optional short summary. Web scraping, content extraction, metadata extraction, article parsing, crawl, RAG inge

Scrape website page to Markdown. Fetch any public web page URL and get clean, LLM-ready text or Markdown: main content, code blocks, tables, links and headings, for RAG and agent context. Static HTML, Markdown or text; optional section ID. Default 20,000 output characters, max 100,000; input 2 MiB. No JavaScript rendering (see /extract/rendered), logins or paywalls. Empty pages, bad sections, brow

Web scraping API for AI agents: read any live web page as clean markdown, text or HTML. Renders JavaScript in our own headless browser, then strips navigation, ads and boilerplate. Use it when a plain HTTP GET returns empty or garbled HTML: single-page apps, dynamic feeds, or content that only appears after scripts run. Also returns the page's HTTP status. Page text is flagged untrusted so an agen

Scrape Creators · TikTok — Ad Library Search

Web search that returns structured SERP results as JSON. Runs on a dedicated SearXNG instance aggregating multiple engines, so there is no per-engine API key, quota or HTML scraping to manage. Each result carries title, URL, snippet, the source engine and a published date where available. Choose general web, news, or image results, up to 10 per call. Use it to ground an answer in current web sourc

Scrapes any webpage and pulls title, description, canonical URL, OpenGraph + Twitter card metadata, headings, and outbound links from a single URL. Server-side rendering; body content rendered as text, raw HTML, or clean markdown, with optional link extraction. Cheerio-based with no headless browser, so it is fast and cheap, ideal for static pages and SSR sites. For JS-heavy SPAs that need a real

Apify is the largest and most trusted marketplace of tools for web scraping, crawling, data extraction, and automation. Use these tools, called Actors, to extract structured data from social media, e-commerce sites, search engines, maps, travel sites, or any other website. Turn the open web into a real-time data source for your research, lead generation, and monitoring.

Headless scraper proxy for AI agents at $0.01 per accepted scrape. Fetch a public HTTPS URL and return clean LLM-ready Markdown. Agent-safety guarantee: output is validated as clean text before serving; binary or garbled content is rejected with no charge.

Headless scraper proxy for AI agents at $0.01 per accepted scrape. Fetch a public HTTPS URL and return clean LLM-ready Markdown. Agent-safety guarantee: output is validated as clean text before serving; binary or garbled content is rejected with no charge.

Free proxy API: get one fast, verified-alive proxy (HTTP, SOCKS) filtered by country, protocol and anonymity, for scraping

Amazon price + price history + monthly sales by ASIN. One call, one ASIN: current buy box, Amazon, lowest new and used prices PLUS 30/90/180-day price averages and the typical 180-day price range, estimated monthly sales, sales rank, rating, review count, offer count, brand, category, image. From tracked marketplace history, not a page scrape. 11 Amazon marketplaces (domain=us, uk, de, fr, jp, ca,

Scrapes any public web page and returns clean structured JSON (title, text, length). The workhorse — agents use this for real data extraction.

Scrape any web page: URL to Markdown / HTML to Markdown for LLM context. Readability article extraction strips nav, ads, scripts, and footers while keeping tables and code blocks. Optional render:true executes JavaScript in a headless browser for SPAs (React/Next/Vue).

IP threat intelligence from first-party honeypot observations (not scraped blocklists): was this IP seen scanning, brute-forcing or probing a live honeypot, which traps it triggered (credential stuffing, webshell, exploit scans, scrapers), bot category and confidence. Works for IPv4 and IPv6.

Given a company website domain, returns a compact company card: the business name and the page element it came from, a generic role contact address (info@, sales@, support@ ...) only if the site publishes one, never a personal address, and the names of up to 10 technology platforms the site runs. Same scrape and evidence check as /scrape, without the evidence detail, at half the price. Free prompt

Metalift scrape: URL → LLM-ready markdown with WAF/retail escalation, JS render, and residential proxy when needed. Use instead of a plain HTTP fetch when Cloudflare, bot checks, or SPAs block cheap scrapers. Also works for static pages (pay only for the path used). (5 credits ≈ $0.005 USDC)

Summarize text. Classify sentiment. Rewrite. Extract keywords. Translate. When to use: cheap agent glue / probe steps for buyer-supplied text. Returns JSON for $0.01 per call in USDC on Base via x402. No API key. Local-fast NLP; no login scrape. Success JSON includes next_tasks hints for same-session follow-ups.

Returns clean, normalized datasets of AI model benchmarks, pricing, leaderboard scores, and Ethereum EIPs, parsed from sources that are costly to scrape.

Use when an agent has an email address from a form, a scrape or a CRM and must decide whether it is worth sending to. Screens the address: syntax, DNS mail exchanger, disposable domain, role account, free provider and common typos. It does not verify that the mailbox exists. A DNS failure answers 503 and is not charged.

Twitter (X) video & image downloader — pass a public tweet / X post URL, get direct CDN media links: .mp4 video URLs with thumbnails plus every image in the post, ready to stream, embed, re-host, or download. No scraping or browser automation.

Find the cheapest suitable API or software service for an agent task (for example PDF text extraction, web scraping, search, weather, email validation). Returns one recommendation plus alternatives with real prices.

Webpage text extraction: extract clean text from any webpage. Extract the clean readable text from a public webpage with title, headings, links and SHA-256; add format=markdown for Markdown or render=true to render JavaScript pages. Web read / fetch URL / scrape URL to markdown — public webpage to clean text or Markdown with headings, links and SHA-256, for RAG and research. Batch up to 10 URLs; o

MSHA mining fatalities feed, newest first, including OPEN preliminary notices (scraped 32–180 days ahead of the official dataset and flagged as preliminary). Filter by date, state, commodity.

Scrape any public web page and get clean structured JSON (title, text, meta). Pay per call with USDC on Base.

Submit an async browser job (screenshot, markdown, scrape, etc.). Returns job_id + poll_url; poll is free with token — no long x402 request hold. Integrators: POST /v1/firecrawl/crawl or /v1/firecrawl/batch/scrape on browser.gedx402.com.

Scrape any public URL to clean markdown