Skip to main content

a scrapy subcommand for easily enqueuing crawling jobs in a scalable and high performance way

Project description

Overview

ScrapyX is a subcommand for scrapy enables you to easily convert your scrapy project to a simple, distributed and high-performance crawling platform, for more info go there: https://github.com/alash3al/scrapy-x

Install

The quick way:

pip install scrapyx

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapy-x-1.0.1.tar.gz (9.1 kB view details)

Uploaded Source

Built Distribution

scrapy_x-1.0.1-py3-none-any.whl (6.4 kB view details)

Uploaded Python 3

File details

Details for the file scrapy-x-1.0.1.tar.gz.

File metadata

  • Download URL: scrapy-x-1.0.1.tar.gz
  • Upload date:
  • Size: 9.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9

File hashes

Hashes for scrapy-x-1.0.1.tar.gz
Algorithm Hash digest
SHA256 7427aa2af7c032febf6a502ec49abb26591b03acda714d9769c756cc49882f0e
MD5 3b6aca7c9ddcfcd79b34b36a1116290e
BLAKE2b-256 8be1175f24345b7af5ea5fc241e86ea4ea6b88e89d6bce9da113fa1e697d60a6

See more details on using hashes here.

File details

Details for the file scrapy_x-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: scrapy_x-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 6.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9

File hashes

Hashes for scrapy_x-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 fc04b1c623c730e09da2de5759359a7a6b743b8d64c852b5e39328813a3fab8a
MD5 d401b5395ce4a6c6e24c03bc269ca606
BLAKE2b-256 5243a4fbf2e721db0ee50ef8d4fd2f48882f9eac94123ceab3a4935dd24e1be2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page