Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.12.0.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f7d87866f1fd9c67d393160a7fffd273202118eb82ed832cd3a1888f3aa7097d |
|
| MD5 | a2dfeecf2006ab747787d6e00a64d996 |
|
| BLAKE2b-256 | 6854c7f41f448f147e8f0870fb10361ca5286dcd4d52e931fc04911599737a00 |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.12.0-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 7c4e52e890ab0732846c354e033fa95eb193c62c04123d5b41368142c7bcf89b |
|
| MD5 | fd44d698f3bf0d58048eada85b8a2ee3 |
|
| BLAKE2b-256 | d0afbc9e21e5fb151482f6a82e947912f945d0fbb4f44a5cf8646195bca8cd03 |
