All projects matching “scrape”

Web scraping proxy API - send a URL, get clean markdown or HTML content back. Supports dynamic rendering.

AI Web Extractor — turn ANY url into clean, LLM-ready markdown. POST {url}; get the main content as markdown (boilerplate/nav/ads stripped) with title, description, and links. The scrape / read / url-to-markdown primitive for RAG and research agents. Fast, cheap, x402-native.

Get contents on internet from the news xInfos API with AI analysis and scraping of various sources

Curated JSON of currently scouted agent earning opportunities (hackathons, bounty boards, agent markets) with prize, deadline, agents_allowed, human_entrant_required, kyc, spend_required, verdict and notes. Seeded from Tali's verified scout vault — use when an agent needs an up-to-date earn map without re-scraping the web.

Scrape Creators · TikTok — Profile

Fee inputs for the next transaction: gas ladder for Base or Ethereum (slow/normal/fast, priority fee, max fee, EIP-1559 base fee) or the priority-fee ladder for Solana, plus the native token price. One call for the numbers a transaction builder needs.

Drop-in Exa-compatible search: the same request (query, numResults, category, includeDomains, excludeDomains, startPublishedDate, contents.text, contents.highlights) and response format (results with id, title, url, publishedDate, author, score, text, highlights) as Exa /search, on Google-quality authority-ranked results, $0.006 with page text included (Exa: $0.007 + per-page fees; resellers $0.01

Verify a California contractor licence by CSLB licence number or business name, returning licence status (normalised and as CSLB words it), classifications, issue and expiry dates, bond and workers' comp. Read live from the CSLB 'Check A License' registry; an unknown licence number is answered free.

XML tier (deterministic, no LLM): verifies a claimed value lives at a named path in a public XML document, by independent double re-fetch. Use it for feeds and sitemaps; for JSON use /verify-json, for HTML use /verify. Paths address elements and @attributes (urlset.url[0].loc). String-exact; ambiguous or volatile values return unverifiable, never a guess. First 100 checks per client are free: rese

TikTok profiles, posts, comments, fast-API feeds, search discovery.

HTML to markdown. $0.002 USDC.

Distributed lock / idempotency primitive for multi-agent swarms. claim(key) returns a token if free (with TTL); release(token) frees it; check(key) reports whether held. Stops multiple agents from double-processing the same work item.

Daily-refreshed ranking of US exchange-listed (NYSE/Nasdaq/CBOE) operating companies with the worst combined distress: Altman Z, Piotroski F and Beneish M verdict risk points plus red-flag severity from recent filings (going concern, auditor change, restatement, delisting notice, late filing). Each row: ticker, distress score, verdict, fraud-risk, top red flags, F/Z/M. Query limit=1-100 (default 2

Fetch a URL and extract clean main-content text with title, description, word count, and char count; boilerplate (nav/footer/sidebar/ads) is stripped.

Fact-check one claim against live web sources (or URLs you supply). Returns a verdict (supported, refuted, mixed, insufficient), a confidence score and supporting or contradicting quotes that are checked verbatim against the fetched pages. Use it before an agent repeats a claim.

Catch drift when everything still looks green. Check available Apify Actor run history and sampled output for schema drift and unexpected empty results. Additional checks cover HTTP responses, credential validity and available quota. One paid call returns a timestamped verdict and supporting details. A successful run or valid credential does not guarantee useful data. This endpoint checks once; it

Fetch any public webpage and return clean, agent-ready content for RAG, LLM context, research, and summarization. Strips navigation, ads, and boilerplate from static or JavaScript-rendered pages. Supports markdown, plain text, or structured JSON output.

Extract title, headings, paragraphs, links from any URL. Body: {"url": "https://example.com"}

Multi-source social+dev data query (dynamic per-request USDC price)

Return the page title and meta description only.

Use before travel, logistics, field work, events or outdoor plans in the US, or to monitor severe weather: returns the currently active National Weather Service alerts (tornado/hurricane/flood/winter storm/heat warnings, watches and advisories) with event, severity, certainty, urgency, headline, affected areas, onset/expiry times, issuing office and a trimmed description and safety instruction (fu

Fetch one public web page now and return clean markdown (or plain text) of the main content plus title, description, author, published time, canonical, language and sha256. Charged only on success.

Deterministic LLM red-team scan: prompt injection, jailbreak, system-prompt extraction and MCP tool abuse in agent prompts.

Search Zillow homes by ZIP code (several per run): for sale by agent, for sale by owner, for rent and recently sold, with price range, days on Zillow (1 to 90) and minimum bedrooms. Up to 25 listings in ONE call with listing status and text, home type, price and formatted price, sold price, full address, coordinates, bedrooms, bathrooms, living area and listing link. $0.025 per call = $0.001 per l

Search public importer and supplier records on ImportYeti, built from shipment data, by company, supplier, product or address phrase: name, type, country, address, total shipments, most recent shipment, top suppliers and customers, trademarks and other names; filters for importers or suppliers, latest shipment within 6 or 12 months and minimum shipments; optional details add trade partners, HS cod

Use to monitor or research public Telegram channels (crypto, news, project announcements, signals): pass a channel username (e.g. durov, telegram, or a t.me link) and get up to 20 recent posts with text, ISO date, view count, outbound links, forwarded-from, photo/video flags and t.me post URLs, plus the channel title, bio and subscriber count. Add q= to search posts within that channel, before= to

Use when you need who holds a token (concentration, whales, treasury): returns the top N holders of an ERC-20 contract on Base or Ethereum with rank, checksummed address, raw and formatted balance, and share of total supply when the explorer provides it. Public name tags and ENS from the explorer are included as labels; no personal identity is invented and emails are stripped. Ethereum prefers Blo

Use for cryptocurrency prices across thousands of coins and tokens: pass CoinGecko ids (bitcoin,ethereum,solana; up to 25) or ticker symbols (BTC,ETH,SOL; up to 5, resolved to the highest-ranked coin with that symbol). Returns price, 24h change %, market cap, 24h volume and last-updated time per coin, in one or more vs currencies (usd default; eur, btc, eth, …). Use /v1/crypto/search to find ids.

Use when an agent needs to search the web: research, fact finding, finding official pages/docs, competitor or link discovery, grounding an answer with URLs. Returns ranked organic results (position, title, url, domain, snippet; published date or lastCrawled time when the source has one). The top 10 come from Bing's public RSS results; deeper pages (count > 10 or page > 1) come from Brave Search. S

Fetch a public web page and return its title, description, clean Markdown (scripts, styles, nav chrome removed) and the list of links. No model call, deterministic.