XCrawl

Live web data for AI agents, RAG and automations

About

XCrawl is a web data API for AI builders. Scrape a URL into Markdown, JSON, HTML or a screenshot; crawl a site with depth rules; map every URL on a domain; or pull structured search results from Google, Bing, DuckDuckGo and others. Proxies, JS rendering and retries run on XCrawl's side. Python and Node SDKs, a CLI, an MCP server and an n8n node are available. New accounts get 1,000 free credits with no credit card.

More in Developer Tools

See all →