ScrapeIt Python SDK

Official Python client for the ScrapeIt Web Scraping API and product APIs (Google SERP, Google Maps, Amazon, Website Crawler and more). Sync and async clients on httpx, request types generated from the ScrapeIt OpenAPI document.

pip install scrapeit-sdk

from scrapeit import Scrapeit, ScrapeitError

client = Scrapeit()  # reads SCRAPEIT_API_KEY, or pass Scrapeit("YOUR_API_KEY")

page = client.scrape(url="https://example.com", jsRendering=True)
print(page["data"])

results = client.google_search(q="coffee near me", gl="us")

import asyncio
from scrapeit import AsyncScrapeit

async def main() -> None:
    async with AsyncScrapeit() as client:
        job = await client.scrape_async(url="https://example.com")
        done = await client.wait_for_async_scrape(job["data"]["id"])
        print(done["data"]["status"])

asyncio.run(main())

Every method returns the API envelope {"data": ..., "meta": ...} and raises ScrapeitError with the stable API error code (for example INSUFFICIENT_CREDITS). 429, 500 and 503 responses are retried automatically with Retry-After.

Documentation: https://docs.scrapeit.io/guide/sdks