All projects matching “scraping”

Submit an async browser job (screenshot, markdown, scrape, etc.). Returns job_id + poll_url; poll is free with token — no long x402 request hold. Integrators: POST /v1/firecrawl/crawl or /v1/firecrawl/batch/scrape on browser.gedx402.com.

Scrape any public URL to clean markdown

Picks Apify Store actors for a scraping or automation task such as 'instagram posts' or 'google maps places'. Returns up to 10 actors ranked by text match, 30-day users and run success rate, with per-event price and an x402 run URL. Not charged when nothing matches.

TEXT-IN ONLY sentiment trajectory: per-item score, inflection points, drift magnitude + model version. Not a trading signal. No scrape / no X. OpenRouter free-first.

AI Web Extractor — turn ANY url into clean, LLM-ready markdown. POST {url}; get the main content as markdown (boilerplate/nav/ads stripped) with title, description, and links. The scrape / read / url-to-markdown primitive for RAG and research agents. Fast, cheap, x402-native.

Offline IBAN MOD-97 (ISO 13616) + BIC/SWIFT format check. No SWIFT directory scrape.

Web scraping proxy API - send a URL, get clean markdown or HTML content back. Supports dynamic rendering.

Curated JSON of currently scouted agent earning opportunities (hackathons, bounty boards, agent markets) with prize, deadline, agents_allowed, human_entrant_required, kyc, spend_required, verdict and notes. Seeded from Tali's verified scout vault — use when an agent needs an up-to-date earn map without re-scraping the web.

Scrape Creators · TikTok — Profile

Get contents on internet from the news xInfos API with AI analysis and scraping of various sources

Gas and priority fees on 5 chains (slow, standard, fast), live. Current gas price, next base fee and priority-fee percentiles (slow, standard, fast) for ethereum, base, arbitrum, optimism and polygon, from the last 5 blocks. Pass chain=all (default) or one chain.

Read URL content: extract the readable plain text and title of any public web page, with scripts, styles and navigation removed, plus character count, truncation flags and read time. Use this when an agent needs the text of an article, doc or product page to quote, classify or summarize, without an API key. Static HTML only (no JavaScript, no login), up to 20,000 characters, JSON out. For Markdown

Returns the page's readable text plus an Ed25519-signed record (final URL after redirects, fetch time, status, sha256 of the body and of the text) that verifies offline. Charged only for 2xx text pages; refused URLs cost nothing.

Opens each URL in a cloud browser and returns one tab per URL, in input order, with the title, content type, extracted text, the accessibility tree and a link map. Results over the inline size limit return a preview per tab plus a download reference. Each call is one request.

All links on a page, absolute and deduplicated, split into internal and external.

Domain intelligence in one call: RDAP registration (registrar, age, expiry, status), live DNS (A/AAAA/MX/NS/TXT), the mail and DNS providers behind them, the SaaS vendors the domain's TXT verification tokens reveal, SPF/DMARC posture, and risk signals like newly-registered or no-registrar-lock.

Business-idea generator: N random collisions of real elements (asset type x asset x pain x channel x revenue model) as raw creative material. Deterministic by seed. ?n=100&seed=42&topic=trust. Boost-start your creative business thinking.

Clean web content extraction — any URL to markdown + text + metadata

YouTube transcript and video search API for AI agents: retrieve timestamped transcript segments by video ID or find videos by keyword. Returns JSON transcripts with text, start and duration, or video search results for content research and summarization. Provided by FastAF YouTube Transcript & Metadata. Price: $0.001000 USDC per successful call.

XML tier (deterministic, no LLM): verifies a claimed value lives at a named path in a public XML document, by independent double re-fetch. Use it for feeds and sitemaps; for JSON use /verify-json, for HTML use /verify. Paths address elements and @attributes (urlset.url[0].loc). String-exact; ambiguous or volatile values return unverifiable, never a guess. First 100 checks per client are free: rese

x402 Bazaar Demand Snapshot (Oct 2026): 3,003 paid endpoints ranked by real payers. Demand-ranked dataset of the Coinbase CDP x402 Bazaar: the 3,003 of 93,116 listed resources with 5 or more First approved purchase: 0.01 USDC total where maker terms permit; later 3 USDC plus tax. Stored ZIP download. Commercial use; no redistribution or resale of the bundle. Verified by Speedbot for this version.

Residential proxy fetch (up to 2MB). Returns HTTP 200 with the target body; read X-Target-Status for the origin status. Billed for the forwarded request, not for a 2xx origin response. For larger responses use /v1/proxy/large; at >17 requests a session pass is cheaper.

Extract up to ten URLs in one paid call.

Audit text for malicious AI-skill patterns. Requires `content`. Nothing to audit — crawling, or discovering this endpoint cold? POST /audit/registry runs the same scanner over the newest servers in the official MCP registry: no input required, $0.005.

Live Amazon offer and inventory data for up to 10 ASINs: every active offer with seller, price, shipping and condition, which one holds the buy box, and optionally the real purchasable stock quantity. Built for repricing, buy-box monitoring and stock-out alerting across 23 marketplaces.

Use when a page will not read correctly with a plain fetch — a single-page app, content loaded by JavaScript, or markup so noisy the text is buried. Fetches it with a headless browser (rendering JavaScript) and returns the main readable content as clean Markdown — ideal to feed an LLM as context. JSON body { url } (public http/https), optional include_images (default false). Returns title, final_u

Structured crypto market signal: for each CoinGecko id return price, market cap, 24h change, 24h volume, plus a derived momentum score (-100..100), a bullish/neutral/bearish signal, and a volatility flag — enriched data an agent ingests in a trading/research loop without computing it itself. Input: ids (comma-separated).

Read the mandatory public disclosure of one domain and return company, postal address, e-mail, phone, VAT and register data with a source for every value.

Pre-payment check of an x402 API endpoint: discovery files, live 402 terms, comparable USDC prices, latency, prompt-injection flags and public Coinbase CDP Bazaar payment statistics for the host. Heuristic, not a guarantee. $0.002; unreachable targets are free. Online shops: pre_purchase_merchant_trust_check.

Extract metadata and readable text from a public URL.