Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.12.1.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1db49e85f6227f243a4c7d7b1ff6d687a4d423bcbb8d1b79adfb7e646ee68240 |
|
| MD5 | 105031e7faa345498541c2e06d53e73b |
|
| BLAKE2b-256 | b0593ab1c2aee552fe7af05aabedd3468b68f81f373169f66543f53538ee898c |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.12.1-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 0c17a3e1c2d935181f03df2d5d32d6d33e7443bc57140e9a031b7921f56a3015 |
|
| MD5 | 97dc975a74c7a5ac995a9313dd306d23 |
|
| BLAKE2b-256 | 516447ce5073e8674b9dcbed466125a6a995bb3a62d2b74f267c366d942f878f |
