Scrapy entrypoint for Scrapinghub job runner
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
- parsing job data from environment
- processing job args and settings
- running a job with Scrapy
- collecting stats
- advanced logging & error handling
- full hubstorage support
- custom scripts support
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications | RSS feed
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Hashes for scrapinghub-entrypoint-scrapy-0.12.1.tar.gz
Hashes for scrapinghub_entrypoint_scrapy-0.12.1-py2.py3-none-any.whl