Skip to main content

Scrapy entrypoint for Scrapinghub job runner

Project description

# scrapinghub-entrypoint-scrapy

[![version](https://img.shields.io/pypi/v/scrapinghub-entrypoint-scrapy.svg)](https://pypi.python.org/pypi/scrapinghub-entrypoint-scrapy) [![pyversions](https://img.shields.io/pypi/pyversions/scrapinghub-entrypoint-scrapy.svg)](https://pypi.python.org/pypi/scrapinghub-entrypoint-scrapy) [![actions](https://github.com/scrapinghub/scrapinghub-entrypoint-scrapy/workflows/Tests/badge.svg)](https://github.com/scrapinghub/scrapinghub-entrypoint-scrapy/actions) [![codecov](https://codecov.io/gh/scrapinghub/scrapinghub-entrypoint-scrapy/branch/master/graph/badge.svg)](https://codecov.io/gh/scrapinghub/scrapinghub-entrypoint-scrapy)

Scrapy entrypoint for Scrapinghub job runner.

The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.

## Features

  • parsing job data from environment

  • processing job args and settings

  • running a job with Scrapy

  • collecting stats

  • advanced logging & error handling

  • full hubstorage support

  • custom scripts support

## Install

pip install scrapinghub-entrypoint-scrapy

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapinghub-entrypoint-scrapy-0.16.0.tar.gz (28.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scrapinghub_entrypoint_scrapy-0.16.0-py2.py3-none-any.whl (37.9 kB view details)

Uploaded Python 2Python 3

File details

Details for the file scrapinghub-entrypoint-scrapy-0.16.0.tar.gz.

File metadata

File hashes

Hashes for scrapinghub-entrypoint-scrapy-0.16.0.tar.gz
Algorithm Hash digest
SHA256 e9c485692efa024662c9c71ec3a4a7594614b86829727cf9ce05403c06815ad9
MD5 15dd87623c91f5d7555d30565e7b19e2
BLAKE2b-256 d509be8572180550bd037d9e064b404a1c18318fd604dfc5dbcc790cc570ec0c

See more details on using hashes here.

File details

Details for the file scrapinghub_entrypoint_scrapy-0.16.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for scrapinghub_entrypoint_scrapy-0.16.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 06fb7ba7a117e77c3f5732182a794baa6445f17b4a7415c0a13228f880efc2e7
MD5 fec6e6d0d33c6da80c210c56f16fb568
BLAKE2b-256 bbed186e7dda0dd346ce80aa6b281f76bfa6c3ac6825c9a88bd9dd6b4501d519

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page