All projects matching “web-scraping”

Web scraping API for AI agents: read any live web page as clean markdown, text or HTML. Renders JavaScript in our own headless browser, then strips navigation, ads and boilerplate. Use it when a plain HTTP GET returns empty or garbled HTML: single-page apps, dynamic feeds, or content that only appears after scripts run. Also returns the page's HTTP status. Page text is flagged untrusted so an agen

Web page scrape: one URL fetched and rendered by Firecrawl (headless browser), returned as markdown, html, rawHtml and/or links. Not charged when the page cannot be fetched.

Page to JSON: scrape and extract any public web page URL into clean structured data JSON. Web scraper / HTML-to-JSON extractor / readability parser for AI agents and LLMs: returns title, author, site name, published date, main article text (plain text), word count, up to 200 links and an optional short summary. Web scraping, content extraction, metadata extraction, article parsing, crawl, RAG inge

AI Web Extractor — turn ANY url into clean, LLM-ready markdown. POST {url}; get the main content as markdown (boilerplate/nav/ads stripped) with title, description, and links. The scrape / read / url-to-markdown primitive for RAG and research agents. Fast, cheap, x402-native.

Company legal-entity lookup from the global LEI system (GLEIF). Send a company name or a 20-character LEI; returns legal name, LEI, status, jurisdiction, legal form, registration number, addresses, the first record's direct and ultimate parents, found or unknown, and provenance (source URLs, retrieval times, SHA-256). Use for know-your-business checks and group-structure questions. Companies only.

Hyperliquid vs Binance vs Bybit predicted funding comparison for one perpetual futures market, plus current funding rate, open interest and basis. Use when an agent monitors a perp position or funding carry. Input: coin (e.g. BTC, ETH, kPEPE). Output: JSON as_of, cache_age_s, 1h + annualized funding, OI coin/USD, mark/oracle/mid, basis %, premium, 24h volume and change, per-venue predicted funding

Details for one on-chain DeFi lending pool (Aave v3, Compound v3, Moonwell, Morpho Blue) by pool id protocol:chain:token_address: supply APY, borrow APY, utilization, TVL and 0-100 risk score. Example: pool_id=aave-v3:base:0x833589fcd6edb6e08f4c7c32d4f71b54bda02913 (Aave Base USDC). Pool ids come from /v1/lookup/yields results. Refreshed about every 30 min

Bulk web search — run up to 5 search queries in one paid call and get ranked results per query (title, URL, snippet, relevance score) as clean JSON. Same news, finance, date-range, country and domain filters as single web search, applied to every query. One payment instead of five for research fan-out, multi-query RAG retrieval and agent planning.

URL safety verdict: follows the redirect chain, detects homograph and punycode hostname tricks, and cross-references the destination host against the URLhaus threat feed. Returns safe, suspicious or malicious with reasons. Single-URL scope; domain-wide grading is /sitegrade and registration facts are /domain-intel.

A task marketplace for agents. POST {spec, reward_credits} escrows the reward and lists the task; GET lists open bounties, GET ?id=X reads one task (any state) incl. its full spec. Workers claim (/bounty/claim), submit results (/bounty/submit); the poster approves (/bounty/approve) and the worker is credited minus a 20% house fee. TO POST: hold reward_credits credits first (POST /credits/buy, $0.0

Get structured metadata for any public web page in one call: title, meta description, canonical URL, Open Graph and Twitter card tags, favicons, JSON-LD schema types, language and the heading outline. Use it to build link previews and social cards, classify or dedupe URLs, and run SEO and AI-readability audits - far cheaper than fetching and parsing the whole page.

Get structured metadata for any public web page in one call: title, meta description, canonical URL, Open Graph and Twitter card tags, favicons, JSON-LD schema types, language and the heading outline. Use it to build link previews and social cards, classify or dedupe URLs, and run SEO and AI-readability audits - far cheaper than fetching and parsing the whole page.

Radar of the freshest Base token launches (newest DEX pools), lightly pre-screened by liquidity/age/flow with quickFlags for obvious junk. Top-of-funnel discovery for trading agents — feeds token-risk / momentum / best-swap. From GeckoTerminal.

Extract structured metadata from any URL: page title, meta description, Open Graph and Twitter Card tags, canonical URL, favicons, language, generator and robots directives, plus RSS/Atom feed links. Give it a URL, get back clean SEO and social-share metadata. No account, no API key — pay per call with x402.

Browser Use: AI browser automation agents in the cloud. POST a natural-language task and an agent navigates websites, fills forms, clicks buttons, extracts structured data, and completes multi-step workflows just like a human. Stealth-enabled remote browsers with CAPTCHA solving, residential proxies, live session view, and optional structured output. Payments top up your balance; managing your ses

Fetch any public webpage and return clean, agent-ready content for RAG, LLM context, research, and summarization. Strips navigation, ads, and boilerplate from static or JavaScript-rendered pages. Supports markdown, plain text, or structured JSON output.

Skuuy Read — URL to clean Markdown (100 reads/day free)

WalletForge wallet balance Base ETH USDC address