All projects matching “llms.txt”

Audits a website for AI agent and AI crawler readiness from caller-supplied inputs: robots.txt, HTML, headers, llms.txt, sitemap lastmod, /.well-known. Names the policy per AI token (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, Gemini-User, KagiBot, Kagi-User, Applebot-Extended, Bytespider, CCBot, Amazonbot, meta-ex

AI and search visibility check for any live URL. Loads the page as Googlebot, Bingbot, OAI-SearchBot, PerplexityBot, GPTBot, ClaudeBot, CCBot and a browser, and flags JSON, empty or blocked pages served to crawlers. Checks robots.txt per bot, sitemap, llms.txt, noindex, text visible without JavaScript, tags, and how many pages Google shows. Returns the top 3 fixes in plain words.

Agent-tier preview of the AI-visibility check: live pass/fail scan of the actual website — robots.txt AI-crawler blocks (GPTBot, ClaudeBot, PerplexityBot, Google-Extended + 10 more), llms.txt presence, Schema.org structured data, sitemap presence — plus a deterministic grade. No fix plan, no prioritization, no evidence rows (those are in the $0.50 full check). Any domain, any country.

AI crawler visibility audit: is your website visible to AI crawlers (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot) so ChatGPT, Claude and Perplexity can read and cite it? Fetched like an AI crawler, without JavaScript: robots.txt, llms.txt, sitemap, soft 404, JSON-LD, and which crawlers are blocked at the edge. $0.01 per check, one payment per check: every rule, a model verdict, a fix with evid

SEO and marketing analytics agent for AI search visibility (AEO/GEO/SEO). Not a deterministic checker: each 0.05 USDC call runs live research and returns a written, prioritised plan for your site, with schema and llms.txt drafts, and remembers your site across calls. Get cited by ChatGPT, Perplexity, Claude and Google AI Overviews.

Fetch a live https URL and score whether the deploy is actually there. POST {"url":"https://your.site","min_score":80} ($0.02). Default x402-seller profile: HTTPS, HSTS, llms.txt, catalog, OpenAPI, MCP, health. Optional claims[] or profile:"web". Returns 0–100, evidence, do_this_first, ci_failed. Humans: GET /v1/tools/claim-check/report?host=your.site. Badge goes stale after 7 days.

Paid equivalent of /api/aeo/scan — scanner for AI search visibility (AEO, GEO) and agent readiness. Triple score + AI Identity Card + top issues covering JSON-LD Schema.org, meta tags, llms.txt, robots.txt, sitemap, and agent-discovery signals for ChatGPT, Perplexity, Google AI Overviews, Bing Copilot. $0.01 in USDC (Base or Solana) — Bazaar-indexable variant; the free version at /api/aeo/scan sta

Read one public https business site: name, offerings, hours, address/phone (markup or tel: only), contact/booking links, email_present (emails never returned), robots AI rules as written, llms.txt, info-only readiness score. As is; not advice or verification. $0.005 USDC x402. Max 3 requests.

x402 seller + agent-readiness audit of one origin: live 402 challenge per paid route (up to 5), price vs catalog, HEAD/garbage-header safety, llms.txt, /.well-known/x402, openapi.json, dead doc links. Read-only.

Web page to Markdown, $0.001 USDC per call: Fetch a public web page and return LLM-ready Markdown: title, meta description, canonical, language, main content (scripts/nav/footer stripped, headings/lists/links kept), first 50 absolute links, word count. Honours robots.txt (disallowed → 403, not charged). No JS rendering; non-HTML → 415. max_chars 500-50000 (default 20000). No params = runs the exam