PennyAPI Web Search

Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live provenance.

Real-time web search for AI agents. Search the web for current and up-to-date information, news, facts, research, documentation, and sources beyond model training data. Returns ranked structured JSON results with title, URL, description, and position for web grounding, RAG retrieval, research, and fact-finding. Send query, optional limit, and optional freshness as URL parameters. Keyless x402 pay-per-call; no API key, account, or subscription required.

Inspect HTTP response headers before an agent trusts or integrates a URL: content type, cache controls, CORS, HSTS, CSP, framing, referrer, permissions policy, server, ETag, and last-modified.

Real-time local business and places search for AI agents. Find restaurants, coffee shops, stores, services, and nearby businesses with structured names, addresses, coordinates, ratings, categories, phone numbers, and websites where available. Send query, optional num, country, and lang as URL parameters. Keyless x402 pay-per-call; no API key, account, or subscription required.

Resolve a URL redirect chain before an agent follows a link. Return the final URL, HTTP status, redirect count, and chain for URL verification and safe navigation.

Preflight an unfamiliar x402 paid API before spending. Validate the live 402 payment challenge, network, USDC asset, amount, payTo recipient, TLS, redirects, manifest presence, latency, and provenance. Returns deterministic GO/REVIEW/STOP and never signs or sends payment to the inspected seller.

Extract webpage metadata for agent research and URL triage: title, description, canonical URL, Open Graph, and Twitter metadata from a public page.