Skip to main content

acrawler-prometheus

The handler works with aCrawler and Prometheus.

Export statistics for:

  • Concurrent requests
  • Task (Requests, Items) counts
  • Queue status

Installation

$ pip install acrawler_prometheus

Usage

Add Handler:

class MyCrawler(Crawler):
    middleware_config = {
        "acrawler_prometheus.PromExporter": 100,
    }

    config = {
        "PROMETHEUS_INTERVAL": 5
    }

Avaliable Config:

PROMETHEUS_ADDR = "localhost"
PROMETHEUS_PORT = 8000
PROMETHEUS_INTERVAL = 1  # exporting interval, in second

Metadata

Release files for acrawler-prometheus 0.0.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for acrawler-prometheus 0.0.4
File Size Uploaded Provenance
acrawler_prometheus-0.0.4.tar.gz 2.2 kB Without provenance Details

Release files / acrawler_prometheus-0.0.4.tar.gz

Download URL acrawler_prometheus-0.0.4.tar.gz
Size 2.2 kB
Tags Source
SHA-256 checksum
How to use checksums
0d2b2a1d360dc371b1a57dee344152cc5622225af040590ce3886e1f3b1f8d0c
BLAKE2b-256 checksum
How to use checksums
1ffbf8238c158ce3beb181c570be0355096dc8eeb112eacdf68cd0ff477465d0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.6.7

Security for acrawler-prometheus 0.0.4

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page