All projects matching “url-to-markdown”

AI Web Extractor — turn ANY url into clean, LLM-ready markdown. POST {url}; get the main content as markdown (boilerplate/nav/ads stripped) with title, description, and links. The scrape / read / url-to-markdown primitive for RAG and research agents. Fast, cheap, x402-native.

URL-to-Markdown web extraction and context compression for AI agents. Fetch a public web page and return clean, task-relevant, citation-verifiable LLM context with exact excerpts, locators, hashes, and estimated tokens saved. Use before an agent summarizes, answers questions from, or cites a long or noisy URL. Deterministic and model-free. Public HTML only; no PDFs, logins, or JavaScript-only page

Convert a public https URL to markdown ($0.005 USDC via x402). https only — http, file, data, localhost, and private IPs are rejected. Caps: 1 MB body, ~10s timeout, max 5 redirects. Returns JSON { url, final_url, title?, content_type, markdown, warnings }.

Extract clean, LLM-ready Markdown or plain text from up to 5 public webpage URLs. Removes page boilerplate and returns structured per-URL results for AI agents, RAG ingestion, research and summarization.

URL safety verdict: follows the redirect chain, detects homograph and punycode hostname tricks, and cross-references the destination host against the URLhaus threat feed. Returns safe, suspicious or malicious with reasons. Single-URL scope; domain-wide grading is /sitegrade and registration facts are /domain-intel.

Extract up to ten URLs in one paid call.

Read the mandatory public disclosure of one domain and return company, postal address, e-mail, phone, VAT and register data with a source for every value.

Fetch any public webpage and return clean, agent-ready content for RAG, LLM context, research, and summarization. Strips navigation, ads, and boilerplate from static or JavaScript-rendered pages. Supports markdown, plain text, or structured JSON output.

PDFs, JavaScript pages and ordinary HTML as clean Markdown. Pays a page's x402 toll for you. Follows robots.txt.

Read any public web page as clean Markdown for LLMs: main content only (no nav, ads, scripts), absolute links, title/description/lang metadata. Respects robots.txt; only successful reads are charged.

Extract clean, LLM-ready Markdown or token-efficient text from any public webpage for RAG ingestion, research, summarization, or agent context. Strips navigation, ads, scripts, forms, and repeated boilerplate; preserves headings and resolved links; labels fetched content as untrusted; and returns at most 50,000 characters.