fastcrawl-cli

Turn any URL into clean, LLM-ready markdown straight from your terminal. Zero dependencies (Python stdlib only).

The Fastcrawl CLI works free out of the box — no API key needed. It uses the guest Fastcrawl try endpoint by default. Set a FASTCRAWL_API_KEY and it transparently upgrades to the full API (scrape, html, all formats).

pip install fastcrawl-cli

Quick start

# Free — no key needed (guest /try, 10 req/hr/IP)
fastcrawl https://example.com

# Save to a file
fastcrawl https://example.com -o page.md

# Full API with a key (scrape endpoint, no rate limits, up to 2,000 free credits/mo)
export FASTCRAWL_API_KEY=fc_...
fastcrawl https://example.com

# Full JSON response (markdown + metadata + credits)
fastcrawl https://example.com --json

Why

• Zero dependencies — pure stdlib, installs anywhere, no bloat.
• Free tier works instantly — guest endpoint, no signup.
• Upgrades seamlessly — the same command hits the full API once you set a key.
• Agent-friendly — clean markdown is exactly what LLM pipelines and RAG need.

Usage

fastcrawl [URL] [-o FILE] [--json] [--html] [--timeout SECONDS]

API

from fastcrawl_cli import scrape

result = scrape("https://example.com")
# {"success": True, "markdown": "...", "duration_ms": 87}

License

MIT. Built with the Fastcrawl API — cloud scraping & crawling for AI agents. 2× the free credits of other scraping APIs.