All projects matching “url”

Trace an HTTP redirect chain to its final destination without downloading page bodies. Returns every hop (URL + status), the final URL, and safety warnings — link-safety grounding for agents before they visit or cite a URL. Clean JSON.

Inspect a public HTTP or HTTPS URL and return a structured site passport. Includes pulse fields, registrable domain, robots and sitemap discovery, feeds, OpenAPI hints, and page metadata. Uses at most eight external HTTP requests and does not execute JavaScript. Pass url as an absolute public HTTP(S) URL. Keep fresh=false to reuse cache; set fresh=true only when a new upstream fetch is required.

Score a URL for phishing risk before an agent opens or trusts it. Keyless, deterministic heuristics - typosquat / homoglyph of a known brand, punycode / mixed-script hosts, credentials-in-URL, raw-IP hosts, suspicious TLDs, over-deep subdomains - plus a best-effort domain-age check (young domains are a top phishing signal). Returns a 0-100 risk score, a SAFE / SUSPICIOUS / DANGEROUS verdict, and l

Extract readable content from any URL as clean Markdown. Strips navigation, ads, footers. Returns title, author, date, word count. 15-min cache per URL. Use when an agent needs webpage content as text.

Give this API a link to any website's sitemap.xml file and it will fetch and parse it, returning every URL found inside. If the sitemap links to other sitemaps (called sitemap indexes), it will follow and extract those too. Each URL is returned with any extra information available, such as when the page was last updated and how often it changes. Useful for SEO audits, content inventories, broken l

Use to extract the main article or document text from a single-page URL. Not for homepages or hubs (Web Index Cleaner) and not a link inventory (Link Extractor). Server HTML only; JavaScript is not run. Output is text or markdown. If the requested extract has no main content, the other profile is tried once in the same request. The HTTP body has correlation_id and data. The item array is data.resu

Fetch any public URL and return its content as base64 with the content type and a ready-to-use data URI. Embed images, PDFs and files directly in LLM and API calls without downloading them yourself. Clean JSON.

Extract metadata and readable text from a public URL.

Extract one or many values from a JSON blob by dot/bracket path (e.g. items[2].name, meta.total). Pull just the fields you need instead of shipping the whole object.

Checks whether a website or web address is currently reachable and reports how fast it responded.

Checks whether a URL/domain is safe to fetch, cite, or follow: flags phantom-squatted or typosquatted brand domains, unregistered or brand-new domains, and known malicious infrastructure (URLhaus). Returns an ALLOW/WARN/BLOCK verdict before your agent trusts the link.

Watch one public page for 7 days. Checks hourly. When the content hash changes, POST {watch_id,url,old_fingerprint,new_fingerprint,changed_at} to your https callback (5s timeout, one retry). POST JSON {"url":"https://example.com","callback_url":"https://example.com/hook"}. Returns {watch_id,url,expires,status_url}. Free status is GET /v1/watch/:id and does not show the callback. At 500 active watc

Fetch a URL and extract structured metadata from its HTML: title, description, canonical URL, language, favicon URL, RSS/Atom feed links, Open Graph tags (og:title, og:image, og:type, og:description, og:url), Twitter Card tags, and other meta tags (author, keywords, robots). Use this to get Open Graph data, preview cards, or site information without parsing HTML yourself. Send {"url": "https://...

Convert HTML to tidy markdown ($0.005 USDC via x402). Pass html (string) and/or url (public https to fetch). At least one required; if both, prefers html and warns. URL fetches use the same allowlist as WELL-002 (https only — http/file/data/localhost/private IPs rejected; 1 MB body, ~10s timeout, max 5 redirects). Returns JSON { source, url?, final_url?, content_type?, markdown, warnings }.

Generate a video from a text prompt, or animate an image_url from its first frame. The paid response waits about as long as the model usually takes to render and returns the video URL, else a statusUrl to poll (Prefer: wait=N sets the wait). 8 models including Google Veo 3.1, Kling 3.0, Seedance 2.5, Wan 2.7 and MiniMax Hailuo 3, 4 to 15 seconds, 16:9 or 9:16, from $0.42. GET this URL for every mo

Fetch a YouTube transcript from a video URL or 11-char id (video_id, also accepted as ref or url); returns a presigned download URL to the transcript

Webpage text extraction: extract clean text from any webpage. Extract the clean readable text from a public webpage with title, headings, links and SHA-256; add format=markdown for Markdown or render=true to render JavaScript pages. Web read / fetch URL / scrape URL to markdown — public webpage to clean text or Markdown with headings, links and SHA-256, for RAG and research. Batch up to 10 URLs; o

Extract structured metadata from any URL: page title, meta description, Open Graph and Twitter Card tags, canonical URL, favicons, language, generator and robots directives, plus RSS/Atom feed links. Give it a URL, get back clean SEO and social-share metadata. No account, no API key — pay per call with x402.

Resolve an HTTP or HTTPS URL through redirects and return the complete redirect chain, HTTP status for each hop, final URL, and redirect safety findings. Use when an agent needs to determine where a URL actually leads before visiting, citing, downloading, or trusting it.

Scrapes a URL and returns structured JSON: title, meta tags, headings, paragraphs, links, tables, extracted emails and phone numbers, and word counts. Accepts a single 'url' or a list of 'urls' for batch scraping. Includes retry logic and anti-detection headers.

Fetch a public https URL and extract HTML head metadata ($0.005 USDC via x402). https only — http, file, data, localhost, and private IPs are rejected. Caps: 1 MB body, ~10s timeout, max 5 redirects. Returns JSON { url, final_url, content_type, title?, description?, canonical?, lang?, open_graph, twitter, warnings }.

Convert a public https URL that returns JSON to tidy markdown ($0.005 USDC via x402). https only — http, file, data, localhost, and private IPs are rejected. Caps: 1 MB body, ~10s timeout, max 5 redirects. Requires JSON content-type or a parseable JSON body. Returns JSON { url, final_url, content_type, markdown, warnings }.

Fetch a public https CSV URL and parse it into headers + rows ($0.005 USDC via x402). https only — http, file, data, localhost, and private IPs are rejected. Caps: 1 MB body, ~10s timeout, max 5 redirects, max 5000 data rows (truncated with warning). Optional has_header (default true). Returns JSON { url, final_url, content_type, headers, rows, row_count, warnings }.

Fetch a public https URL that returns text and compute byte/char/line/word counts plus SHA-256 ($0.005 USDC via x402). https only — http, file, data, localhost, and private IPs are rejected. Caps: 1 MB body, ~10s timeout, max 5 redirects. Rejects image/audio/video/octet-stream. Returns JSON { url, final_url, content_type, byte_length, char_count, line_count, word_count, sha256, warnings }.

AI Web Extractor — turn ANY url into clean, LLM-ready markdown. POST {url}; get the main content as markdown (boilerplate/nav/ads stripped) with title, description, and links. The scrape / read / url-to-markdown primitive for RAG and research agents. Fast, cheap, x402-native.

Convert a public https URL to markdown ($0.005 USDC via x402). https only — http, file, data, localhost, and private IPs are rejected. Caps: 1 MB body, ~10s timeout, max 5 redirects. Returns JSON { url, final_url, title?, content_type, markdown, warnings }.

Fetch a public https URL, compute SHA-256 of the response body, and report whether it changed vs a prior sha256/etag ($0.01 USDC via x402). Sticky: store sha256 and call again later. Optional previous_sha256, previous_etag, include_body_if_changed. https only — http, file, data, localhost, and private IPs rejected. Caps: 1 MB body, ~10s timeout, max 5 redirects. Returns JSON { url, final_url, cont

Convert a public https RSS 2.0 or Atom feed URL to tidy markdown ($0.005 USDC via x402). https only — http, file, data, localhost, and private IPs are rejected. Caps: 1 MB body, ~10s timeout, max 5 redirects. Optional max_items (default 20, cap 50). Returns JSON { url, final_url, feed_title?, feed_link?, format, items, markdown, item_count, warnings }.

Universal social post stats for $0.01. Pass any public post URL from instagram.com, tiktok.com, twitter.com, or x.com as ?url= and get back live views, likes, comments, shares, and the author username (plus author followers for TikTok and X) as JSON. The platform is auto-detected from the URL hostname. Great default endpoint for agents that just have a link.

Fetch any public webpage and return its clean readable text and markdown: boilerplate, nav, ads and scripts stripped. Returns the page title, clean text, markdown, word count and final URL after redirects. Input: a public http(s) URL. Errors for bad or non-HTML URLs are returned free (settlement is cancelled on failure).