Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.11.0.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | eb19ad10f019c9a02f480c8de66d4b1b1b1e06ec7f4d18ffc90f9e14f3a46803 |
|
| MD5 | 595cbd000300b19f65d41a3bff013277 |
|
| BLAKE2b-256 | 2734672086889acc37ee4a172dad68ba07dab6e15b91c6bd3b63bf0b8342f610 |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.11.0-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9aaefbb19fd7f2163e99e34e9c2f6d849029a19bab956bdd6f3d77dc4a187611 |
|
| MD5 | 9c09e9baef5842cb5bc96eb745c0958a |
|
| BLAKE2b-256 | aebeea647c06592aa961071fbbc4d35709a8e53b55ec0364a10044763f7e9418 |
