webglean

Official Python client for the WebGlean API.

pip install webglean

from webglean import WebGlean

client = WebGlean(api_key="wg_your_key")  # or set WEBGLEAN_API_KEY

result = client.scrape("https://example.com")
print(result["markdown"])

WebGlean also works as a context manager (with WebGlean(...) as client:), which closes the underlying HTTP connection pool on exit.

Methods

crawl_and_wait and batch_scrape_and_wait poll every 2s by default (poll_interval, timeout in seconds) until the job finishes, raising WebGleanError (status 0) on timeout.

Errors

Any non-2xx response raises WebGleanError, with .status and the message set from the API's error body.

Development

python3 -m venv .venv && source .venv/bin/activate
pip install -e ".[dev]"
pytest