Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
- parsing job data from environment
- processing job args and settings
- running a job with Scrapy
- collecting stats
- advanced logging & error handling
- full hubstorage support
- custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
| Filename, size | File type | Python version | Upload date | Hashes |
|---|---|---|---|---|
| Filename, size scrapinghub_entrypoint_scrapy-0.10.2-py2.py3-none-any.whl (34.9 kB) | File type Wheel | Python version py2.py3 | Upload date | Hashes View hashes |
| Filename, size scrapinghub-entrypoint-scrapy-0.10.2.tar.gz (25.3 kB) | File type Source | Python version None | Upload date | Hashes View hashes |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.10.2-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5c63b11151d253c859f8fbc7295c93adacf98c8c4c53e6903c81b9bc0497a43a |
|
| MD5 | 00c88a945b874994440223d434bb08df |
|
| BLAKE2-256 | 535d214651f8b6fa979feefa907ea75a0924795c6ee66498cfa0d595438ade15 |
Close
Hashes for scrapinghub-entrypoint-scrapy-0.10.2.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4b44d04061d912a71f4cb051aa09ff798ab544bf71e93e9b7f9b51a95eb4f58a |
|
| MD5 | e125eaee90545e07c37e7df0fed56154 |
|
| BLAKE2-256 | d9914f8c269124780f6c00c5f5753e45064d605f60db2abf30a31ab194d27b3b |
