a scrapy subcommand for easily enqueuing crawling jobs in a scalable and high performance way
Project description
Overview
- A distributed, scalable and lightweight environment for deploying and running scrapy spiders/projects with no-hassle on commodity hardware, also it is compatible with scrapyd /schedule.json and /daemonstatus.json
, for more info go there: https://github.com/alash3al/scrapy-x
Install
The quick way:
pip install scrapy-x
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-x-1.9.tar.gz
(9.9 kB
view details)
Built Distribution
File details
Details for the file scrapy-x-1.9.tar.gz.
File metadata
- Download URL: scrapy-x-1.9.tar.gz
- Upload date:
- Size: 9.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8430d0af24da498b66e9f4388b23b09c0d084d9f22a708f0076ae2e84522ce8d |
|
| MD5 | 143cba901d18c76e3dd3d2d17d28213f |
|
| BLAKE2b-256 | 79e66647150c2b11f41a98cb856354c875c824c0814e524e0add882884c9a3d3 |
File details
Details for the file scrapy_x-1.9-py3-none-any.whl.
File metadata
- Download URL: scrapy_x-1.9-py3-none-any.whl
- Upload date:
- Size: 7.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 558637b1d769a41a81099be825c4c532d5f22df6db6e6b70e6795e3193e23770 |
|
| MD5 | 4b2fcd195090feafa62b10ed2be12ddc |
|
| BLAKE2b-256 | 481821d6ad0c14a88b9d9b5715e2d80f37b656ad147063049a59e8e8eba28374 |
