Skip to main content

Export Scrapy spider stats to InfluxDB.

Project description

scrapy-influxdb-exporter

Export Scrapy spider stats to InfluxDB.

Installation

pip install scrapy-influxdb-exporter

Usage

Add the following settings to your Scrapy project settings file:

INFLUXDB_DATABASE = ...
INFLUXDB_HOST = ...
INFLUXDB_MEASUREMENT_NAME = ...
INFLUXDB_ORG = ...
INFLUXDB_TOKEN = ...
STATS_CLASS = "scrapy_influxdb_exporter.InfluxDBStatsCollector"

Acknowledgments

This project was inspired by scrapy-prometheus-exporter by @rangertaha and this article by @mikulskibartosz.

Contributing

Contributions are welcome! To get started, please refer to our contribution guidelines.

Issues

If you encounter any problems while using this package, please open a new issue here.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapy_influxdb_exporter-1.2.1.tar.gz (3.4 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file scrapy_influxdb_exporter-1.2.1.tar.gz.

File metadata

File hashes

Hashes for scrapy_influxdb_exporter-1.2.1.tar.gz
Algorithm Hash digest
SHA256 8f724f90bd5ccbde2d03cea3088a5ff67fd0726bb253c21e04f17070522ce949
MD5 39262b719eb9d6fc5c13fe281cb33600
BLAKE2b-256 f4549f1c37733802c493ac2bca4afb2b151efb60efef6b130380ef9ea0770fdf

See more details on using hashes here.

File details

Details for the file scrapy_influxdb_exporter-1.2.1-py3-none-any.whl.

File metadata

File hashes

Hashes for scrapy_influxdb_exporter-1.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 b12eb86ed2c7b7cf40d2dd49fb56355c0710f6716a5bb1b9c2a4663c56636b7e
MD5 c2c4fb6dcf7692e17af7ab469d9fb9bb
BLAKE2b-256 cd42f4b8b046ac91d573632b68622de57a229571e3606e665233b3f3206590d3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page