Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
1 maintainer
Metadata
1 maintainer
Release files for scrapinghub-entrypoint-scrapy 0.10.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| scrapinghub-entrypoint-scrapy-0.10.2.tar.gz | 25.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| scrapinghub_entrypoint_scrapy-0.10.2-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 60.2 kB
Release files / scrapinghub-entrypoint-scrapy-0.10.2.tar.gz
| Download URL | scrapinghub-entrypoint-scrapy-0.10.2.tar.gz |
|---|---|
| Size | 25.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
4b44d04061d912a71f4cb051aa09ff798ab544bf71e93e9b7f9b51a95eb4f58a
|
|
BLAKE2b-256 checksum How to use checksums |
d9914f8c269124780f6c00c5f5753e45064d605f60db2abf30a31ab194d27b3b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / scrapinghub_entrypoint_scrapy-0.10.2-py2.py3-none-any.whl
| Download URL | scrapinghub_entrypoint_scrapy-0.10.2-py2.py3-none-any.whl |
|---|---|
| Size | 34.9 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
5c63b11151d253c859f8fbc7295c93adacf98c8c4c53e6903c81b9bc0497a43a
|
|
BLAKE2b-256 checksum How to use checksums |
535d214651f8b6fa979feefa907ea75a0924795c6ee66498cfa0d595438ade15
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
