Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.10.0.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3457b3e1a3dd47c317f9f1cd43da9f2bac509791b9c4d1ca6432c2861d19d224 |
|
| MD5 | a7ea39d72f33af7cbad932a5199def2a |
|
| BLAKE2b-256 | a4a5309ce4a3ea41f30223cf8a455d63663b0a75df4ab051ed508686a1f98f27 |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.10.0-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 683333ead48c484ef078dab6e2bbbbb4ac963e28d9467d259d8ef7fd1cc3ec88 |
|
| MD5 | 1ae0fc34340a0f7ef9ab12905e20e6af |
|
| BLAKE2b-256 | 36e0ee1645da52b26726c3e9280b2e5a3c3edda48d55cf42bac78c274387a69a |
