Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
- parsing job data from environment
- processing job args and settings
- running a job with Scrapy
- collecting stats
- advanced logging & error handling
- full hubstorage support
- custom scripts support
Requirements
- Python 2/3
- Scrapy, python-hubstorage (check requirements.txt for details)
Install
The quick way:
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
| Filename, size | File type | Python version | Upload date | Hashes |
|---|---|---|---|---|
| Filename, size scrapinghub_entrypoint_scrapy-0.8.8-py2-none-any.whl (28.7 kB) | File type Wheel | Python version py2 | Upload date | Hashes View hashes |
| Filename, size scrapinghub-entrypoint-scrapy-0.8.8.tar.gz (20.6 kB) | File type Source | Python version None | Upload date | Hashes View hashes |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.8.8-py2-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 2b0893bf41beac44348bec8a766b36c7810907c28c4a2f41533de7f79ce98221 |
|
| MD5 | 9de128de4b0925d47e0bb27788d4d193 |
|
| BLAKE2-256 | 7067a35ec841b9abc5c7338f0ab87e4c03a1ebc11e522948a4978777ac213cbd |
Close
Hashes for scrapinghub-entrypoint-scrapy-0.8.8.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 780c1ef03523283dd03f3094e3ffce1867780ab5faa3d675de56dafdb91485ee |
|
| MD5 | 8fa3fc723da7df1ea3c6b61548c5e5f2 |
|
| BLAKE2-256 | 3024c115a9211e7f59b3d73cf6b4b92b3e1c920e5632bacce460679e0656d62d |
