All projects on Base matching “web scraping”

Web scraping API for AI agents: read any live web page as clean markdown, text or HTML. Renders JavaScript in our own headless browser, then strips navigation, ads and boilerplate. Use it when a plain HTTP GET returns empty or garbled HTML: single-page apps, dynamic feeds, or content that only appears after scripts run. Also returns the page's HTTP status. Page text is flagged untrusted so an agen

Firecrawl v2 API proxy — scrape. JSON body matches https://docs.firecrawl.dev/api-reference/v2-introduction. Poll GET routes are free; POST/PUT/DELETE are x402. $0.042 USDC per request. Agent search: scrape, markdown, firecrawl, web scrape, scrape-lite.

Web page scrape: one URL fetched and rendered by Firecrawl (headless browser), returned as markdown, html, rawHtml and/or links. Not charged when the page cannot be fetched.

Page to JSON: scrape and extract any public web page URL into clean structured data JSON. Web scraper / HTML-to-JSON extractor / readability parser for AI agents and LLMs: returns title, author, site name, published date, main article text (plain text), word count, up to 200 links and an optional short summary. Web scraping, content extraction, metadata extraction, article parsing, crawl, RAG inge

Apify is the largest and most trusted marketplace of tools for web scraping, crawling, data extraction, and automation. Use these tools, called Actors, to extract structured data from social media, e-commerce sites, search engines, maps, travel sites, or any other website. Turn the open web into a real-time data source for your research, lead generation, and monitoring.

Find the cheapest suitable API or software service for an agent task (for example PDF text extraction, web scraping, search, weather, email validation). Returns one recommendation plus alternatives with real prices.

Web scraping proxy API - send a URL, get clean markdown or HTML content back. Supports dynamic rendering.

Scrape any web page: URL to Markdown / HTML to Markdown for LLM context. Readability article extraction strips nav, ads, scripts, and footers while keeping tables and code blocks. Optional render:true executes JavaScript in a headless browser for SPAs (React/Next/Vue).

Curated JSON of currently scouted agent earning opportunities (hackathons, bounty boards, agent markets) with prize, deadline, agents_allowed, human_entrant_required, kyc, spend_required, verdict and notes. Seeded from Tali's verified scout vault — use when an agent needs an up-to-date earn map without re-scraping the web.

Scrapes any public web page and returns clean structured JSON (title, text, length). The workhorse — agents use this for real data extraction.

Scrape any public web page and get clean structured JSON (title, text, meta). Pay per call with USDC on Base.

Webpage text extraction: extract clean text from any webpage. Extract the clean readable text from a public webpage with title, headings, links and SHA-256; add format=markdown for Markdown or render=true to render JavaScript pages. Web read / fetch URL / scrape URL to markdown — public webpage to clean text or Markdown with headings, links and SHA-256, for RAG and research. Batch up to 10 URLs; o

Scrape website page to Markdown. Fetch any public web page URL and get clean, LLM-ready text or Markdown: main content, code blocks, tables, links and headings, for RAG and agent context. Static HTML, Markdown or text; optional section ID. Default 20,000 output characters, max 100,000; input 2 MiB. No JavaScript rendering (see /extract/rendered), logins or paywalls. Empty pages, bad sections, brow

Web search that returns structured SERP results as JSON. Runs on a dedicated SearXNG instance aggregating multiple engines, so there is no per-engine API key, quota or HTML scraping to manage. Each result carries title, URL, snippet, the source engine and a published date where available. Choose general web, news, or image results, up to 10 per call. Use it to ground an answer in current web sourc

AI Web Extractor — turn ANY url into clean, LLM-ready markdown. POST {url}; get the main content as markdown (boilerplate/nav/ads stripped) with title, description, and links. The scrape / read / url-to-markdown primitive for RAG and research agents. Fast, cheap, x402-native.

Fetch a public web page and return just the main article as clean Markdown, with title, byline and excerpt. Menus, ads and footers are removed. Use when you need to read, summarise or quote a web page cheaply without parsing HTML yourself. Returns JSON {title, byline, siteName, excerpt, markdown}. Errors: 400 bad or private URL, 422 no readable article, 502 site returned an error.