Skip to main content

Scrapy entrypoint for Scrapinghub job runner

Project description

Scrapy entrypoint for Scrapinghub job runner.

The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.


  • parsing job data from environment
  • processing job args and settings
  • running a job with Scrapy
  • collecting stats
  • advanced logging & error handling
  • full hubstorage support
  • custom scripts support


pip install scrapinghub-entrypoint-scrapy

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for scrapinghub-entrypoint-scrapy, version 0.12.0
Filename, size File type Python version Upload date Hashes
Filename, size scrapinghub_entrypoint_scrapy-0.12.0-py2.py3-none-any.whl (35.7 kB) File type Wheel Python version py2.py3 Upload date Hashes View
Filename, size scrapinghub-entrypoint-scrapy-0.12.0.tar.gz (26.1 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page