Scrapy entrypoint for Scrapinghub job runner
Project description
# scrapinghub-entrypoint-scrapy
[![version](https://img.shields.io/pypi/v/scrapinghub-entrypoint-scrapy.svg)](https://pypi.python.org/pypi/scrapinghub-entrypoint-scrapy) [![pyversions](https://img.shields.io/pypi/pyversions/scrapinghub-entrypoint-scrapy.svg)](https://pypi.python.org/pypi/scrapinghub-entrypoint-scrapy) [![actions](https://github.com/scrapinghub/scrapinghub-entrypoint-scrapy/workflows/Tests/badge.svg)](https://github.com/scrapinghub/scrapinghub-entrypoint-scrapy/actions) [![codecov](https://codecov.io/gh/scrapinghub/scrapinghub-entrypoint-scrapy/branch/master/graph/badge.svg)](https://codecov.io/gh/scrapinghub/scrapinghub-entrypoint-scrapy)
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
## Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
## Install
pip install scrapinghub-entrypoint-scrapy
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for scrapinghub_entrypoint_scrapy-0.17.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b3c3c46ea61ce1b4cabe5ccddea1daa1ebc94cf86e3ee6fe0184a91f1e33021 |
|
MD5 | 394a0694ced2df9f153dfc1e5763fca0 |
|
BLAKE2b-256 | 137273b9c912d5f556ad530300acb2f7dac5c798e2c6ba88100dcbfda8c4a7cd |
Hashes for scrapinghub_entrypoint_scrapy-0.17.3-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a9b8c20aae8a5541e704bf6da82b1c18ed61fe1000ca8901b6dad20272e8066d |
|
MD5 | 4e0e7a4e9b387b5fb44bbb232a7c9faf |
|
BLAKE2b-256 | 046d58354802f1af13611b6e94e05869d1408dc6624f269809340db7aba82e7b |