Skip to main content

The handler working with aCrawler and Prometheus

Project description

acrawler-prometheus

The handler works with aCrawler and Prometheus.

Export statistics for:

  • Concurrent requests
  • Task (Requests, Items) counts
  • Queue status

Installation

$ pip install acrawler_prometheus

Usage

Add Handler:

class MyCrawler(Crawler):
    middleware_config = {
        "acrawler_prometheus.PromExporter": 100,
    }

    config = {
        "PROMETHEUS_INTERVAL": 5
    }

Avaliable Config:

PROMETHEUS_ADDR = "localhost"
PROMETHEUS_PORT = 8000
PROMETHEUS_INTERVAL = 1  # exporting interval, in second

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for acrawler-prometheus, version 0.0.4
Filename, size File type Python version Upload date Hashes
Filename, size acrawler_prometheus-0.0.4.tar.gz (2.2 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page