Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.13.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | aa22f36a967445c42946804c13eb6d09afc37e00b1730398d9ac1046d478f3e4 |
|
MD5 | 72da99ae6da8777d01f86b3acdf1129a |
|
BLAKE2b-256 | 94f679da97c8e24d35a0c7f22ca747f68164cef47592a3aef31cfc24ca11118c |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.13.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1db48f9ac0ce9de2c4317b3dc2c201f09287d15778ed1f1c4f6cec3b7afd7863 |
|
MD5 | 1f166521604110f4a9f847eca0dfd982 |
|
BLAKE2b-256 | 7c52b172b51358f06a9676c7d374e4c9df0d97d9e8d2ede1beabdb5905b500c6 |