Skip to main content

a scrapy subcommand for easily enqueuing crawling jobs in a scalable and high performance way

Project description

Overview

ScrapyX is a subcommand for scrapy enables you to easily convert your scrapy project to a simple, distributed and high-performance crawling platform, for more info go there: https://github.com/alash3al/scrapy-x

Install

The quick way:

pip install scrapy-x

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapy-x-1.1.tar.gz (9.4 kB view details)

Uploaded Source

Built Distributions

scrapy_x-1.1-py3.6.egg (11.9 kB view details)

Uploaded Source

scrapy_x-1.1-py3-none-any.whl (6.7 kB view details)

Uploaded Python 3

File details

Details for the file scrapy-x-1.1.tar.gz.

File metadata

  • Download URL: scrapy-x-1.1.tar.gz
  • Upload date:
  • Size: 9.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9

File hashes

Hashes for scrapy-x-1.1.tar.gz
Algorithm Hash digest
SHA256 cf14a560aac9893759ee902e35a6a8bf672f2bddce32455c0808ac48d83677e7
MD5 f7a7c0c1fc712f1f1912a48c702c37bf
BLAKE2b-256 c8e633eeb62db0c299adefef0068667806f8a8e7b532cfce62fd228ccc4e6d99

See more details on using hashes here.

File details

Details for the file scrapy_x-1.1-py3.6.egg.

File metadata

  • Download URL: scrapy_x-1.1-py3.6.egg
  • Upload date:
  • Size: 11.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9

File hashes

Hashes for scrapy_x-1.1-py3.6.egg
Algorithm Hash digest
SHA256 6113fc1acd2d46330c47fdf1aa646c2ea8892e309a48355d1e3923cc60e2bd24
MD5 40d62aad1b106dc85b434b71ddf736e4
BLAKE2b-256 53e8a9c4d548dedef4dd582bce1bae899eff0f29d0572c2445359bed120bf816

See more details on using hashes here.

File details

Details for the file scrapy_x-1.1-py3-none-any.whl.

File metadata

  • Download URL: scrapy_x-1.1-py3-none-any.whl
  • Upload date:
  • Size: 6.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9

File hashes

Hashes for scrapy_x-1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 290558428b106ba9ccd359ef0ec37800b0d41656bdc5288c41488e870f2a5403
MD5 203b056f1389b0ac9d4ddad7ef964aaf
BLAKE2b-256 240ec3611aed5686d6c35185db076bd7dc9b8b74c2daa586c8d613b3cb425ddf

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page