a scrapy subcommand for easily enqueuing crawling jobs in a scalable and high performance way
Project description
Overview
- A distributed, scalable and lightweight environment for deploying and running scrapy spiders/projects with no-hassle on commodity hardware, also it is compatible with scrapyd /schedule.json and /daemonstatus.json
, for more info go there: https://github.com/alash3al/scrapy-x
Install
The quick way:
pip install scrapy-x
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-x-1.7.tar.gz
(9.7 kB
view details)
Built Distribution
File details
Details for the file scrapy-x-1.7.tar.gz.
File metadata
- Download URL: scrapy-x-1.7.tar.gz
- Upload date:
- Size: 9.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 279d6abf95750fcf4a7b883b00b819db0d0a0e92695a1cef66820ee71918cac4 |
|
| MD5 | 6a97b06b9fbbe2fdea801fb6834630f3 |
|
| BLAKE2b-256 | 56c0b611f02ebdcad3870193d6c50150f170ceb28b6fc338f6147915df32c911 |
File details
Details for the file scrapy_x-1.7-py3-none-any.whl.
File metadata
- Download URL: scrapy_x-1.7-py3-none-any.whl
- Upload date:
- Size: 7.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b096f9ded819ca49eb1ff19c6f2ee1dd7963b6e75ade32d966cea60eceb88c73 |
|
| MD5 | c40d9339768e2ad083e479356c468b18 |
|
| BLAKE2b-256 | 16ebc17fb09ef266ff6d7b3241bb291df572ef86b4419ea209430024fdfcecef |
