Skip to main content

a scrapy subcommand for easily enqueuing crawling jobs in a scalable and high performance way

Project description

Overview

A distributed, scalable and lightweight environment for deploying and running scrapy spiders/projects with no-hassle on commodity hardware, also it is compatible with scrapyd /schedule.json and /daemonstatus.json

, for more info go there: https://github.com/alash3al/scrapy-x

Install

The quick way:

pip install scrapy-x

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapy-x-1.6.tar.gz (9.6 kB view details)

Uploaded Source

Built Distributions

scrapy_x-1.6-py3.6.egg (12.4 kB view details)

Uploaded Source

scrapy_x-1.6-py3-none-any.whl (6.9 kB view details)

Uploaded Python 3

File details

Details for the file scrapy-x-1.6.tar.gz.

File metadata

  • Download URL: scrapy-x-1.6.tar.gz
  • Upload date:
  • Size: 9.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9

File hashes

Hashes for scrapy-x-1.6.tar.gz
Algorithm Hash digest
SHA256 916c7778d4c94838cb75880e637a2c30bcb4dd26f7e9a369cb572afda464347e
MD5 d421be0fb47a0a0358805bfc80a3395c
BLAKE2b-256 2b210f0f9df4ff99eef2b454ee5b34c89dd0b7c41a45a1ce75e90caa46f60880

See more details on using hashes here.

File details

Details for the file scrapy_x-1.6-py3.6.egg.

File metadata

  • Download URL: scrapy_x-1.6-py3.6.egg
  • Upload date:
  • Size: 12.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9

File hashes

Hashes for scrapy_x-1.6-py3.6.egg
Algorithm Hash digest
SHA256 dad7d9c01091ba7851a6fabc733e6237e494f4c01b39c2a17705a9eeccd46139
MD5 dbb5af87b68b09047dd6a30e8cf64d46
BLAKE2b-256 72fbd0ffb2cc00012ed816e5061d2f3429c891abc472c66234963a11d3e4fed8

See more details on using hashes here.

File details

Details for the file scrapy_x-1.6-py3-none-any.whl.

File metadata

  • Download URL: scrapy_x-1.6-py3-none-any.whl
  • Upload date:
  • Size: 6.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9

File hashes

Hashes for scrapy_x-1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 7145ea48e68930264aff125f24f3cef4090faec2e18fd24c51dea9a9fb5c63f1
MD5 14f259fef73c60ae492ce898cc2ed689
BLAKE2b-256 699e3bea32ade852e291d3ca0ed6c50ed6a830700a83da9b8d78c1ece3a46bb4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page