The handler working with aCrawler and Prometheus
Project description
acrawler-prometheus
The handler working with aCrawler and Prometheus.
Export statistics for:
- Concurrent requests
- Task (Requests, Items) counts
- Queue status
Installation
$ pip install acrawler_prometheus
Usage
Add Handler:
class MyCrawler(Crawler):
middleware_config = {
"acrawler_prometheus.PromExporter": 100,
}
config = {
"PROMETHEUS_INTERVAL": 5
}
Avaliable Config:
PROMETHEUS_ADDR = "localhost"
PROMETHEUS_PORT = 8000
PROMETHEUS_INTERVAL = 1 # exporting interval, in second
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Close
Hashes for acrawler_prometheus-0.0.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 58d7305330d6d2344c6e3a8f89d80b08afaa9da5187de1044543907e4f567168 |
|
MD5 | 22da855f34a43902cae2961f1bd2d8ea |
|
BLAKE2b-256 | 996b07a965f4db3ec9d61c05ba7762bc05412b5824f56580c928f1849d63995d |