All projects matching “site”

Does a website use Beaver Builder? Fetches the page (homepage for a bare domain) and matches Beaver Builder's fingerprints in the HTML and response headers, returning yes/no with the evidence snippet and the category (page-builder). Technographics for sales, competitor research and migration planning, one technology per call. $0.01 per check.

Live USGS river-gauge tick, deterministic. Answers "what is the flow at this gauge right now", "is this river high or low vs this week". Returns the latest streamflow (discharge, cfs) and gage height (ft) for one USGS site plus the 7-day min/max range, reading count, site name and coordinates, straight from USGS instantaneous values. Unknown sites 404 before payment. No LLM, no key, public domain.

Buy a site upload slot. Upload a zip file, then activate to extract and serve as a static site.

Cheap robots.txt preflight check before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether Minifetch may fetch a target URL (allow/deny) plus its crawl-delay. If blocked and the site is not yours try our external proxy routes. If blocked and the site is yours or to set a custom crawl-delay read https://minifetch.com/tutorials/unblock-minifetch Checks the URL as give

Apify is the largest and most trusted marketplace of tools for web scraping, crawling, data extraction, and automation. Use these tools, called Actors, to extract structured data from social media, e-commerce sites, search engines, maps, travel sites, or any other website. Turn the open web into a real-time data source for your research, lead generation, and monitoring.

Given a company website domain, returns a compact company card: the business name and the page element it came from, a generic role contact address (info@, sales@, support@ ...) only if the site publishes one, never a personal address, and the names of up to 10 technology platforms the site runs. Same scrape and evidence check as /scrape, without the evidence detail, at half the price. Free prompt

SEO and marketing analytics agent for AI search visibility (AEO/GEO/SEO). Not a deterministic checker: each 0.05 USDC call runs live research and returns a written, prioritised plan for your site, with schema and llms.txt drafts, and remembers your site across calls. Get cited by ChatGPT, Perplexity, Claude and Google AI Overviews.

Dragons Eye Lookup: Ransomware leak-site claim lookup by company name or domain. Returns ransomware-group claims (group, dates, country, sector, sources) matching the company or domain. Unverified claims from criminal leak sites; commercially reusable sources only.

Watch up to 25 domains for 30 days for new ransomware leak-site claims. $2.00 USDC on Base, paid once. Checked every 15 minutes; on a domain or exact-name match you get a signed webhook. Validate entries free first at POST /v1/watchlists/validate. Alerts are unverified claims from criminal leak sites, commercially reusable sources only.

Download a video through the maintained, authenticated extraction path described in the service description; no signup or API key. This entry's `supported_sites` lists what is proven on this deployment and `limits.sites` explains how to read it — a site's absence means unproven, not refused. Returns a zip by signed URL. This is the tool that is hard to replicate yourself.

Use when you need the list of pages a site publishes (to crawl it, find recent posts, or audit SEO): give a site URL (the sitemap is discovered from robots.txt Sitemap: lines, then /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml) or a sitemap URL directly. Returns the page URLs with lastmod, changefreq and priority; for a sitemap index, returns its child sitemaps and (expand=true, default) the U

Neural and keyword web search. Optional category filter: company, research paper, news, pdf, github, tweet, personal site, linkedin profile, financial report.

Current Craigslist listings for one site and category (e.g. sfbay + cta = cars & trucks, newyork + apa = apartments), optionally matching a search query: title, price, area and listing URL, newest first as Craigslist orders them, read from the public search page. Up to ~300 results per call; no contact details or full post text.

Scrapes any webpage and pulls title, description, canonical URL, OpenGraph + Twitter card metadata, headings, and outbound links from a single URL. Server-side rendering; body content rendered as text, raw HTML, or clean markdown, with optional link extraction. Cheerio-based with no headless browser, so it is fast and cheap, ideal for static pages and SSR sites. For JS-heavy SPAs that need a real

Fetch a public web page and return just the main article as clean Markdown, with title, byline and excerpt. Menus, ads and footers are removed. Use when you need to read, summarise or quote a web page cheaply without parsing HTML yourself. Returns JSON {title, byline, siteName, excerpt, markdown}. Errors: 400 bad or private URL, 422 no readable article, 502 site returned an error.

Search the web and read the top pages in ONE call: 10 results (title, url, snippet, date) plus the clean text of the best pages, with fetch time and sha256. French and Canada by default when the query is French; official-sources mode (governments, registries, courts, laws); freshness filter; site: restriction. No results = HTTP 404 = you are not charged. Input: query, optional read (0-5), official

Fetch a site's robots.txt and evaluate crawl permissions: given a URL (plus optional extra paths) and a user-agent, return whether each path is allowed or disallowed, the rule that matched, the user-agent group, the crawl-delay and any declared sitemaps. Implements the Robots Exclusion Protocol (RFC 9309) with longest-match-wins, Allow-over-Disallow tie-breaking and * / $ wildcards.

Web search API for AI agents: live Google search results (SERP) for any query as clean JSON, with ranked title, URL, snippet and date, plus the answer box. Search the web or search news only; filter by date (past hour to past year), keep to or leave out up to 5 sites. A fast Google search API / SERP API for grounding, RAG, research, fact checks and finding sources. Results via Serper.

DNS TXT record lookup — a domain's TXT records as a clean JSON list: SPF, DKIM and DMARC policy strings plus site-verification and domain-ownership tokens, for email-authentication and domain-verification checks.

Hotel details & rates — one hotel's full profile by property token: address, phone, per-booking-site nightly & total rates, rooms, amenities & review breakdown as clean JSON.

Is this domain malicious or named by ransomware? Domain threat check. $0.02 USDC on Base per call. Matches the hostname, parent domains and resolved IPv4 against ThreatCluster's high-confidence 30-day IOC feed and looks up ransomware leak-site claims. Returns one verdict: listed, claimed, listed_and_claimed or no_known_threat. Don't use this for many domains; use /v1/bulk-threat-check.

Multi-page research brief with cited sources. Crawl one URL and follow its links, or pass a list of URLs, and get a synthesized answer to your question as JSON with a sources array, optionally shaped by your JSON Schema. Use it to compare several pages, gather a list across a site, summarise a topic from multiple sources, or answer a question that spans documents. Up to 8 pages per call, typically

YouTube transcript API: the full transcript of a YouTube video (or another site with captions) from its own captions in seconds, as txt, srt, vtt or JSON segments with timestamps, title and language. No speech recognition, flat price per video up to 4 hours. Videos without captions are refused before payment; use /v1/transcribe for those.

Use when you have a company domain and need to know what the company is before spending more. Returns the company name and site title, domain age, registrar, mail provider, DNS provider, DMARC and HTTPS status, and a count of the third-party vendors detected. One call, no signup, no API key. The cheapest way to qualify a domain before buying a fuller record.

Prepaid credit of $0.10 for paid API calls without signing each request. On PageAudit it pays for fix prompts for coding agents at $0.10 each after 3 free units and 30-day plans that check 25, 100 or 300 more pages every day, with a weekly site report, from $3.99. The same token pays the paid APIs of our other products.

eBay listings search — live prices, condition, shipping, seller reputation, auctions & Buy It Now across supported regional eBay sites, with category, price band, condition, seller & location filters, sorted, as clean JSON.

Stacktree: host generated HTML as a live, shareable web page on a permanent, private, unguessable link ($0.50). POST any HTML (a report, dashboard, landing page, static site, or any webpage an agent produced) with payment; we return the URL and a one-time claim token. No account, no key, no human in the loop. The paying wallet can update the page free at the same URL, and a deleted page is restora

Starts a website migration comparison: checks page existence, content and visual regression between a source site and its migrated copy, then produces a report with screenshots. Use it to verify a migration or redesign before go-live. Priced on the pages it compares (the urls list, or the pages discovery finds, at most the optional maxPages ceiling), no page limit: 0.02 USD per page for the first

Fetch one public static HTML page after robots and public-address checks, then return bounded readable text, title, final URL and source links. Standard x402: POST the URL, sign the 402 and resend the same body. The 402 also returns an encrypted payment_request that pays for exactly the quoted fetch. No browser, login, summary or full-site crawl.

Fetch a URL and extract structured metadata from its HTML: title, description, canonical URL, language, favicon URL, RSS/Atom feed links, Open Graph tags (og:title, og:image, og:type, og:description, og:url), Twitter Card tags, and other meta tags (author, keywords, robots). Use this to get Open Graph data, preview cards, or site information without parsing HTML yourself. Send {"url": "https://...