Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.10.1.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 0b34cb4a51d2b9b4f4f78342f0bb6e4923704ad61f05c628df05a9a9a4d59816 |
|
| MD5 | b24baf931bb5d15aa701654056a6a7c1 |
|
| BLAKE2b-256 | a009e5df70d4ca0764e8f4d822d3fbaa1d5e0db74a989e8d1f3782f2d0a46109 |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.10.1-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 0f1678c3d05982019010112ebda165b11995865412269583f885144f56de9e48 |
|
| MD5 | adf9463ebe2bac627f00c69bad6ef9bd |
|
| BLAKE2b-256 | fa7687a95934daf0cba3b14bfb3003465fed58a7e589d2bc0ab7e7d9bb0fcf4c |
