Skip to main content

Official Python SDK for the CrawlSnap threat-intelligence API

Project description

crawlsnap

Official Python SDK for the CrawlSnap threat-intelligence API — on-demand IoC enrichment for URLs, file hashes, IPv4 addresses, and domains.

  • Idiomatic, fully typed client (httpx + pydantic v2)
  • crawlsnap.init(...) singleton or an explicit CrawlSnap client
  • Resource namespacing: crawlsnap.vector_snap.ip(...)
  • Returns typed data; raises typed exceptions — no envelope bookkeeping
  • Built-in retries with exponential backoff, configurable timeout, auto-pagination

Installation

pip install crawlsnap

Requires Python 3.8+.

Authentication

Get an API key (sk-cs-...) from your CrawlSnap dashboard. Provide it either via the environment or explicitly:

export CRAWLSNAP_API_KEY=sk-cs-...
crawlsnap.init()                       # reads CRAWLSNAP_API_KEY
crawlsnap.init(api_key="sk-cs-...")    # or pass it explicitly

The key is sent as Authorization: Bearer sk-cs-.... Treat it like a password.

Quick start

import crawlsnap

crawlsnap.init(api_key="sk-cs-...")

ip = crawlsnap.vector_snap.ip("8.8.8.8")
print(ip.reputation, ip.as_owner, ip.country)

Each call returns the typed enrichment payload directly, and raises a typed exception on failure — you never inspect an is_success envelope yourself.

Resources

Resource Methods Returns
vector_snap url · hash · ip · domain reputation, detections, categories, relationships
pulse_snap url · hash · ip · domain threat-intelligence pulse (and sandbox) summary
subdo_snap scan · scan_iter enumerated subdomains (paginated)
url    = crawlsnap.vector_snap.url("https://example.com")
file   = crawlsnap.vector_snap.hash("44d88612fea8a8f36de82e1278abb02f")
domain = crawlsnap.vector_snap.domain("google.com")

pulse  = crawlsnap.pulse_snap.ip("8.8.8.8")

Every method takes the indicator as the first positional argument and accepts raw_response=True (see below).

Error handling

Failures raise a typed exception instead of returning an error envelope:

from crawlsnap import (
    NotFoundError, RateLimitError, QuotaExceededError,
    AuthenticationError, CrawlSnapError,
)

try:
    res = crawlsnap.vector_snap.domain("example.com")
except NotFoundError:
    ...                              # 404 — no data for this indicator
except QuotaExceededError as e:
    print(e.message)                 # 402 — out of credits / monthly quota
except RateLimitError as e:
    print(e.retry_after)             # 429 — daily limit; seconds to wait
except AuthenticationError:
    ...                              # 401 — missing / invalid key
except CrawlSnapError as e:          # base class for every SDK error
    print(e)
HTTP Exception Notes
400 BadRequestError invalid indicator
401 AuthenticationError missing / invalid key
402 QuotaExceededError out of credits or monthly quota
403 SubscriptionInactiveError subscription not active
404 NotFoundError no data for the indicator
429 RateLimitError daily limit; .retry_after (seconds)
5xx ServerError server / upstream failure
APIConnectionError / APITimeoutError network failure / client timeout

Every status error carries .status_code, .message, and .request_id (share the request id with support to speed up debugging).

Pagination

subdo_snap is paginated. Stream every subdomain across all pages — the cursor is handled for you:

for subdomain in crawlsnap.subdo_snap.scan_iter("example.com"):
    print(subdomain)

Or page manually:

page = crawlsnap.subdo_snap.scan("example.com")
while page.cursor:
    page = crawlsnap.subdo_snap.scan("example.com", cursor=page.cursor)

Configuration

The singleton is a thin layer over the CrawlSnap client. For multiple keys, multiple environments, or thread isolation, instantiate it directly:

from crawlsnap import CrawlSnap

client = CrawlSnap(
    api_key="sk-cs-...",
    timeout=30.0,
    max_retries=3,
    base_url="https://api.crawlsnap.com",
)
ip = client.vector_snap.ip("1.1.1.1")
client.close()
Option Default Description
api_key $CRAWLSNAP_API_KEY Your sk-cs- key
base_url $CRAWLSNAP_BASE_URL or https://api.crawlsnap.com API host override
timeout 30.0 Per-request timeout (seconds)
max_retries 2 Retries for 429 / 5xx / connection errors

Retries use exponential backoff and honor the Retry-After header on 429.

Raw response

Pass raw_response=True to get the full envelope (status, headers, request id) instead of just the data:

raw = crawlsnap.vector_snap.ip("8.8.8.8", raw_response=True)
print(raw.status_code, raw.request_id, raw.is_success, raw.data)

Development

The typed models under crawlsnap/models/ are generated from the public OpenAPI contract; the client facade is hand-written. To refresh the models after the contract changes:

./scripts/regenerate.sh        # re-bundles the contract and regenerates models/

Run the tests:

pip install -e ".[dev]"
pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawlsnap-0.1.0.tar.gz (17.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

crawlsnap-0.1.0-py3-none-any.whl (58.6 kB view details)

Uploaded Python 3

File details

Details for the file crawlsnap-0.1.0.tar.gz.

File metadata

  • Download URL: crawlsnap-0.1.0.tar.gz
  • Upload date:
  • Size: 17.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for crawlsnap-0.1.0.tar.gz
Algorithm Hash digest
SHA256 655b4fa635dac6674a7e40810d3be13947e7491510bbf8a68b3050510fdcf84f
MD5 0db6062252fea238c8fe9db7a4887e84
BLAKE2b-256 40c542e7c24b042efedfad9d17e8f0ed722cee3a5811404d790d9b6bbefdb892

See more details on using hashes here.

Provenance

The following attestation bundles were made for crawlsnap-0.1.0.tar.gz:

Publisher: release.yml on crawlsnap/crawlsnap-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file crawlsnap-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: crawlsnap-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 58.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for crawlsnap-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 dc18390503636aaa4a8bf6eb6f0947bfdc8f0a8669d353840af4d6a6eec9b0cc
MD5 815cd7ff717eaf300d1278653b417e0d
BLAKE2b-256 728b1fb28d7f26f366115a7d21e167b12e0dd379254a44b3a1da28782ffa5747

See more details on using hashes here.

Provenance

The following attestation bundles were made for crawlsnap-0.1.0-py3-none-any.whl:

Publisher: release.yml on crawlsnap/crawlsnap-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page