All projects matching “http”

Audit a URL's HTTP security headers over a single body-free (HEAD) request. Grades Strict-Transport-Security, Content-Security-Policy, X-Frame-Options, X-Content-Type-Options, Referrer-Policy and Permissions-Policy, flags information-leak headers (Server, X-Powered-By), and returns the parsed values plus advisory warnings. Clean JSON for security and pentest automation.

Send an HTTP request to any URL from our servers and receive the full response — including the status code, all response headers, and the body content. Supports GET, POST, PUT, PATCH, DELETE, and HEAD. Automatically follows up to 3 redirects. Useful for testing endpoints, verifying servers are responding correctly, debugging redirect chains, or fetching raw data without needing a local setup.

Fetch a site's robots.txt and evaluate crawl permissions: given a URL (plus optional extra paths) and a user-agent, return whether each path is allowed or disallowed, the rule that matched, the user-agent group, the crawl-delay and any declared sitemaps. Implements the Robots Exclusion Protocol (RFC 9309) with longest-match-wins, Allow-over-Disallow tie-breaking and * / $ wildcards.

Give this API a list of up to 10 web addresses and it will visit each one to tell you whether it is working, broken, or redirecting visitors somewhere else. You get back the exact status number (like 200 for OK, 404 for not found, 500 for server error), whether the address redirects, and where it redirects to. Great for finding broken links, verifying website migrations, and running quick SEO audi

Sends a request to a web address you provide and reports back everything the server said in response: the status code, all the response headers, how many times it got redirected, and how long the whole thing took.

Inspect a public HTTP or HTTPS URL and return a structured site passport. Includes pulse fields, registrable domain, robots and sitemap discovery, feeds, OpenAPI hints, and page metadata. Uses at most eight external HTTP requests and does not execute JavaScript. Pass url as an absolute public HTTP(S) URL. Keep fresh=false to reuse cache; set fresh=true only when a new upstream fetch is required.

Web scraping API for AI agents: read any live web page as clean markdown, text or HTML. Renders JavaScript in our own headless browser, then strips navigation, ads and boilerplate. Use it when a plain HTTP GET returns empty or garbled HTML: single-page apps, dynamic feeds, or content that only appears after scripts run. Also returns the page's HTTP status. Page text is flagged untrusted so an agen

Pay $0.01 USDC to make an outbound HTTP request through the proxy. Supports all standard HTTP methods, custom headers (including auth), and JSON or raw bodies. Responses are returned as text or base64-encoded binary. Max response size 10 MB, timeout 30s. Each request performs one upstream fetch and returns the final URL plus response metadata.

Resolve an HTTP or HTTPS URL through redirects and return the complete redirect chain, HTTP status for each hop, final URL, and redirect safety findings. Use when an agent needs to determine where a URL actually leads before visiting, citing, downloading, or trusting it.

Probe an agent-payable HTTP endpoint for current availability, latency, HTTP status, x402 challenge support, and response-schema validity.

Avoid unnecessary browser launches with a lightweight preflight for AI agents. ZeroWorker inspects public pages before browser automation and returns static forms, field constraints, CAPTCHA/SPA signals, DNS/public-network safety checks, and a 3-state routing verdict: http_candidate, browser_likely, or undetermined. Use it to choose direct HTTP or escalate to a browser. No API key required. $0.003

A2A, MCP & HTTP 402 Endpoint SLA Compliance Auditor (/v1/x402-audit) — Audits any remote agent or MCP URL for JSON-RPC compliance, latency SLA, OpenAPI schema, and HTTP 402 settlement headers. (https://preflight.agentdiet.dev/v1/preflight/certify)

PDL Person Enrich — career history, emails, phone. Requires one of: `email`, `profile` (LinkedIn URL), or `first_name` + `last_name` + (`company_name` OR `company_domain`). `{ first_name, last_name }` alone returns 400. Prefer `email` when known, then `profile`. No match: HTTP 200, status 404, data null — not billed. Match: $0.28.

Liveness/latency pre-flight for a URL: is it up, HTTP status and class, response latency in ms, whether it redirects (and where), content-type and server.

Cheapest real end-to-end test of your pay-per-call (HTTP 402) client: pay US$0.002, get back what was paid (payer, amount, network, timestamp) and the text you sent; the settlement receipt is in the PAYMENT-RESPONSE header. A free trial call returns paid_usd 0. Use it to check a wallet, a client library or a facilitator before buying something bigger.

Unblocker for AI agents: send {url} and get the page back as clean Markdown, with title, description, language, final URL and HTTP status. Gets through Cloudflare and other common bot protection and can render JavaScript-heavy pages. Set format to html or text for those instead. A page that can't be fetched (blocked, error status or empty) is not charged. No API key, proxy or account: pay per call

Measure real-world page load performance (response time) for any URL from a chosen global location. Returns total load time in seconds, HTTP response status, a phase-by-phase timing breakdown (DNS, TCP connect, TLS handshake, time-to-first-byte, content transfer), and a content preview. Useful for global latency monitoring, CDN validation, and uptime/performance checks from multiple geographic ori

x402 endpoint checker: decodes an x402 endpoint's 402 payment terms without paying. GET url (optional method GET/POST, JSON body for POST). Sends one unpaid request; never pays or signs. Returns JSON: httpStatus, isX402, x402Version, decoded accepts (network, asset, USD amount, payTo, EOA or contract), discovery metadata presence, and pass/warn/fail checks. Any HTTP answer from the target, even 4x

Cheapest real end-to-end test of your pay-per-call (HTTP 402) client: pay US$0.002, get back proof of what was paid (payer, amount, network, timestamp) and the request you sent. Use it to check a wallet, a client library or a facilitator before buying something bigger.

Search the web and read the top pages in ONE call: 10 results (title, url, snippet, date) plus the clean text of the best pages, with fetch time and sha256. French and Canada by default when the query is French; official-sources mode (governments, registries, courts, laws); freshness filter; site: restriction. No results = HTTP 404 = you are not charged. Input: query, optional read (0-5), official

Capture a PNG screenshot of a single CSS-selected element on an http(s) URL; returns a JSON envelope with the PNG base64-encoded under image_base64, plus selector, final_url, title, viewport, and size.

Use to extract the main article or document text from a single-page URL. Not for homepages or hubs (Web Index Cleaner) and not a link inventory (Link Extractor). Server HTML only; JavaScript is not run. Output is text or markdown. If the requested extract has no main content, the other profile is tried once in the same request. The HTTP body has correlation_id and data. The item array is data.resu

Is this x402 API trustworthy? Body {url}. Returns its latest Kertivo Index endpoint trust score/grade (A, B, F, C-never-live, C-went-dark, or ungraded) and run date, plus evidence from a real paid test call: 402 status, price, payTo, settlement tx, on-chain check, HTTP status after paying, latency, schema and delivery result. Not in the index: status not_indexed. Also a public claims tally (buyer-

Free proxy API: get one fast, verified-alive proxy (HTTP, SOCKS) filtered by country, protocol and anonymity, for scraping

Website HTTP and metadata inspection report

Residential proxy fetch (up to 2MB). Returns HTTP 200 with the target body; read X-Target-Status for the origin status. Billed for the forwarded request, not for a 2xx origin response. For larger responses use /v1/proxy/large; at >17 requests a session pass is cheaper.

Extract clean, boilerplate-free readable text from one known public HTTP(S) URL for LLM research or RAG ingestion; private, local, authenticated, paywalled, or blocked resources are not supported. USE WHEN: agent already knows the URL and needs clean page text. DO NOT USE WHEN: agent needs web search, multi-page research, comparison, structured web workflow, or change detection. USE web-intelligen

Metalift scrape: URL → LLM-ready markdown with WAF/retail escalation, JS render, and residential proxy when needed. Use instead of a plain HTTP fetch when Cloudflare, bot checks, or SPAs block cheap scrapers. Also works for static pages (pay only for the path used). (5 credits ≈ $0.005 USDC)

Use when an agent must verify a company (KYC/KYB, supplier or invoice check): official legal name, address, legal form, active/dissolved, LEI, register number, VAT validity. Search by name= (+country=), id=, lei= or vat=. GLEIF worldwide plus official national registers: FR, NO, FI, LV, IE, GB, US, EE, TW, HK, SG, AU – also firms without LEI. Source named in every answer. Bad input: HTTP 400 befor

Probe a peer x402 jobs URL and return a CC0 x402-probe-receipt-v1 (HTTP status, PAYMENT-REQUIRED body/header agreement, latency). Interop helper for agent operators. Does not settle. Keywords: x402, probe, 402, interop, b2b.