Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.11.2.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | ff171a6fb61fc5904b15e2718a67676d0d38ae19421db0e1dc27918e058c423f |
|
| MD5 | f727c1fcfde5159b1dc4b95b566d9ec7 |
|
| BLAKE2b-256 | e71f0f18f2de3fb3d1cefb94369f3b0b4b039901fac86544db7e707e6560d266 |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.11.2-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 88e3e6107ffef406e0de56ba92cc9249e17187b84eb6793bda2b6dfe4b6ef121 |
|
| MD5 | 35828ddddd5ecdfdfdfef13978218b33 |
|
| BLAKE2b-256 | 99f174d3e5c3fb049521bddaaf0a121521ad16e721d5f2d53755e32bcf389dbb |
