Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.11.1.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 0e8c0ed6b3aff9bba332cec120f6a2ae60f721ceb28c79c7769fdffe7b81acae |
|
| MD5 | 7445946985c84e7cb26161a21fd80b09 |
|
| BLAKE2b-256 | 506dabbe8f2a815576a5aae6c75520a7d6d5b6717eb24b044375edf4d58feb92 |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.11.1-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 60e3d96bb96ad64936a7d1cbf808bf5718eebb4b8d1402a1f403f9edc391c0da |
|
| MD5 | 526a240c14f5a1fc15c7f47103820f78 |
|
| BLAKE2b-256 | 9ba267bf1730fbfeaa73e675b84a13fe3822ee65e845374f3c0255d5ef90fea4 |
