Skip to main content

A package to deploy scrapy spiders to Heroku

Project description

Herokuify-Scrapyd

This package was mainly developed to make deploying Scrapy spiders to Heroku easy.

Features

  • Support Python >=3.6 and Scrapy 1.5.1
  • Support running scrapyd locally
  • Support running scrapyd on Heroku

Configuration

On your scrapy.cfg file copy & paste the following:

[scrapyd]
application = herokuify_scrapyd.app.application

[deploy]

url = http://<HEROKU_APP_NAME>.herokuapp.com
project = <PROJECT_NAME>
username = <HEROKU_EMAIL>
password = <HEROKU_PASSWORD>

Now on you project root directory create a file called Procfile and inside it write:

web: scrapyd

Project details


Release history Release notifications | RSS feed

This version

1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

herokuify_scrapyd-1.0.tar.gz (2.1 kB view details)

Uploaded Source

Built Distribution

herokuify_scrapyd-1.0-py3-none-any.whl (3.5 kB view details)

Uploaded Python 3

File details

Details for the file herokuify_scrapyd-1.0.tar.gz.

File metadata

  • Download URL: herokuify_scrapyd-1.0.tar.gz
  • Upload date:
  • Size: 2.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.6.5

File hashes

Hashes for herokuify_scrapyd-1.0.tar.gz
Algorithm Hash digest
SHA256 1787080badd5f3a729ef3dfa6ccf7a5b2cd70c07188fcae5e7a4af4988c09059
MD5 c427ae6fca18beda059ad1260ff06ebe
BLAKE2b-256 cda0b5c9fa2c4add0aedcabe023801b8dd5b047940f22b1ba4ae61e430e53003

See more details on using hashes here.

File details

Details for the file herokuify_scrapyd-1.0-py3-none-any.whl.

File metadata

  • Download URL: herokuify_scrapyd-1.0-py3-none-any.whl
  • Upload date:
  • Size: 3.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.6.5

File hashes

Hashes for herokuify_scrapyd-1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 d35a6b67fcff8831fb9f7ac4c288bea5a6775378a25c4bc4b1d8a4b7a95e0322
MD5 ff775e39c018c226a25820922704c916
BLAKE2b-256 2d63429be7ea23638f706409662b642c662139ff6874cdee5dcbe41e918c27b7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page