Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.10.2.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4b44d04061d912a71f4cb051aa09ff798ab544bf71e93e9b7f9b51a95eb4f58a |
|
| MD5 | e125eaee90545e07c37e7df0fed56154 |
|
| BLAKE2b-256 | d9914f8c269124780f6c00c5f5753e45064d605f60db2abf30a31ab194d27b3b |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.10.2-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5c63b11151d253c859f8fbc7295c93adacf98c8c4c53e6903c81b9bc0497a43a |
|
| MD5 | 00c88a945b874994440223d434bb08df |
|
| BLAKE2b-256 | 535d214651f8b6fa979feefa907ea75a0924795c6ee66498cfa0d595438ade15 |