All projects matching “fetch url”

Signed extractability score (0-100) + breakdown + fixes for a URL. Free preview: GET /extractability/preview Blocked or bad input returns 400; a failed fetch returns 502; you are never charged for an error.

Search copies AfterImage already fetched. Does not hit the live web. Empty hits: GET /v1/page with the URL.

Inspect a public HTTP or HTTPS URL and return a structured site passport. Includes pulse fields, registrable domain, robots and sitemap discovery, feeds, OpenAPI hints, and page metadata. Uses at most eight external HTTP requests and does not execute JavaScript. Pass url as an absolute public HTTP(S) URL. Keep fresh=false to reuse cache; set fresh=true only when a new upstream fetch is required.

Use ping when you need a pass/fail verdict that a URL serves expected content: expected HTTP status (default 200), a required body substring, and/or an exact match on one JSON field. One automated fetch at request time, signed receipt with per-condition results. POST the tool inputs as JSON to paid_url with an x402 v2 PAYMENT-SIGNATURE header. See https://docs.cdp.coinbase.com/x402

Fetch one public static HTML page after robots and public-address checks, then return bounded readable text, title, final URL and source links. Standard x402: POST the URL, sign the 402 and resend the same body. The 402 also returns an encrypted payment_request that pays for exactly the quoted fetch. No browser, login, summary or full-site crawl.

Use before spending tokens, money or crawler capacity fetching an unfamiliar web resource. Resolves redirects (manually, bounded, re-validated per hop) and returns deterministic HTTP/resource facts — final URL, status, content type and length, response time, a bounded HTML title/canonical peek, and a lightweight generic-bot robots.txt indication — so an agent can decide whether a normal web fetch

Read the main content of a page your own crawler cannot reach, as clean markdown. Send a URL and receive the main content of the page as clean markdown, stripped of navigation, advertising and boilerplate. The page is fetched through a French residential IP with a real Chromium browser, so JavaScript-rendered content is fully resol…

Metalift scrape: URL → LLM-ready markdown with WAF/retail escalation, JS render, and residential proxy when needed. Use instead of a plain HTTP fetch when Cloudflare, bot checks, or SPAs block cheap scrapers. Also works for static pages (pay only for the path used). (5 credits ≈ $0.005 USDC)

Fetch a public web page and convert it to clean Markdown (title, description, headings, absolute links). LLM-free, deterministic, honours robots.txt. ?url=

Fact-check one claim against live web sources (or URLs you supply). Returns a verdict (supported, refuted, mixed, insufficient), a confidence score and supporting or contradicting quotes that are checked verbatim against the fetched pages. Use it before an agent repeats a claim.

Use when a page will not read correctly with a plain fetch — a single-page app, content loaded by JavaScript, or markup so noisy the text is buried. Fetches it with a headless browser (rendering JavaScript) and returns the main readable content as clean Markdown — ideal to feed an LLM as context. JSON body { url } (public http/https), optional include_images (default false). Returns title, final_u

Structured JSON from a web page or text, with exactly the fields you ask for. $0.01 USDC per call on Base, no API key. POST JSON { schema: { field: type, ... } (required), plus url or text }. Returns { data } with your schema's keys (null when a field is not in the source), the model used and latency_ms. Page fetch capped at 10 s, whole call at 45 s, so it never hangs.

Fetch any public webpage and return its clean readable text and markdown: boilerplate, nav, ads and scripts stripped. Returns the page title, clean text, markdown, word count and final URL after redirects. Input: a public http(s) URL. Errors for bad or non-HTML URLs are returned free (settlement is cancelled on failure).

Full transcript of any YouTube video by video id or URL: captions/subtitles as clean plain text plus timestamped segments, the video's chapter markers, and every caption track it offers so an agent can pick a language and re-fetch. YouTube transcript, video to text, captions extraction, subtitle download, closed captions, speech to text, multilingual, asr and authored tracks. No API key.

Cheap web search for AI agents: give it a query, get up to 10 live web results back as JSON (rank, title, url, domain, snippet). Optional region (e.g. us-en) and safe-search level. Sources tried in order: DuckDuckGo, Bing, Yahoo. Results link to the live web; pair with a /read service to fetch the pages.

Unblocker for AI agents: send {url} and get the page back as clean Markdown, with title, description, language, final URL and HTTP status. Gets through Cloudflare and other common bot protection and can render JavaScript-heavy pages. Set format to html or text for those instead. A page that can't be fetched (blocked, error status or empty) is not charged. No API key, proxy or account: pay per call

You.com Search API: real-time web search returning ranked results grouped by section (results.web, results.news), each with url, title and description; web results also carry snippets. Use when an agent needs fresh, citable web data (news, markets, company facts) to ground a decision. Query params: query (required), count 1-100 (default 10), livecrawl (web|news|all; fetches live page contents, cha

Checks an x402 API origin the way x402scan, the CDP Bazaar and agents read it: fetches /openapi.json and /.well-known/x402, then calls each paid route without paying (up to 30) and decodes its 402. Reports routes that do not answer 402, missing or v1-only PAYMENT-REQUIRED headers, prices that differ from the OpenAPI document, resource URLs that differ from the route, wrong USDC EIP-712 domains, mi

Send an HTTP request to any URL from our servers and receive the full response — including the status code, all response headers, and the body content. Supports GET, POST, PUT, PATCH, DELETE, and HEAD. Automatically follows up to 3 redirects. Useful for testing endpoints, verifying servers are responding correctly, debugging redirect chains, or fetching raw data without needing a local setup.

Fetch a public web page and return just the main article as clean Markdown, with title, byline and excerpt. Menus, ads and footers are removed. Use when you need to read, summarise or quote a web page cheaply without parsing HTML yourself. Returns JSON {title, byline, siteName, excerpt, markdown}. Errors: 400 bad or private URL, 422 no readable article, 502 site returned an error.

Web page to markdown (read URL as clean text) for LLM agents: main content only (no nav, cookie banners, ads), with title, description, author, dates, language, headings, internal/external links and JSON-LD types, PLUS a prompt-injection scan of the page (visible text, hidden HTML, comments, invisible Unicode) so your agent knows whether the content tries to give it orders. Fetched from Cloudflare