Scrapy entrypoint for Scrapinghub job runner
Project description
# scrapinghub-entrypoint-scrapy
[![version](https://img.shields.io/pypi/v/scrapinghub-entrypoint-scrapy.svg)](https://pypi.python.org/pypi/scrapinghub-entrypoint-scrapy) [![pyversions](https://img.shields.io/pypi/pyversions/scrapinghub-entrypoint-scrapy.svg)](https://pypi.python.org/pypi/scrapinghub-entrypoint-scrapy) [![actions](https://github.com/scrapinghub/scrapinghub-entrypoint-scrapy/workflows/Tests/badge.svg)](https://github.com/scrapinghub/scrapinghub-entrypoint-scrapy/actions) [![codecov](https://codecov.io/gh/scrapinghub/scrapinghub-entrypoint-scrapy/branch/master/graph/badge.svg)](https://codecov.io/gh/scrapinghub/scrapinghub-entrypoint-scrapy)
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
## Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
## Install
pip install scrapinghub-entrypoint-scrapy
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for scrapinghub-entrypoint-scrapy-0.17.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4b074a31046bd395b7e726a8f5cae12b8f7d06470e048a3898fa117a8f1a1035 |
|
MD5 | 595307bb463f7ed9b90d89b8e9ae296f |
|
BLAKE2b-256 | 183b46b2834feb474e41820e7fefcd2ac47ee808e66bd36b36c52de613e28262 |
Hashes for scrapinghub_entrypoint_scrapy-0.17.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e5f2b77c0db8dacb8ea08c9993e6b1f30b7930e04694c6646d4d3b31b0a9fbd8 |
|
MD5 | fb47f8d2eab681a50b1b6e34c0fc7b0e |
|
BLAKE2b-256 | 82a8455ee127da3e421a5646dd14e99e69358b44c76d10a9b253c5dbd6b7a2af |