a scrapy subcommand for easily enqueuing crawling jobs in a scalable and high performance way
Project description
Overview
ScrapyX is a subcommand for scrapy enables you to easily convert your scrapy project to a simple, distributed and high-performance crawling platform, for more info go there: https://github.com/alash3al/scrapy-x
Install
The quick way:
pip install scrapy-x
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-x-1.2.tar.gz
(9.5 kB
view details)
Built Distributions
scrapy_x-1.2-py3.6.egg
(12.1 kB
view details)
File details
Details for the file scrapy-x-1.2.tar.gz
.
File metadata
- Download URL: scrapy-x-1.2.tar.gz
- Upload date:
- Size: 9.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f631031d565f7aa36d4d612013949608329dd905e084ddb649f71af6908330a5 |
|
MD5 | 05c9e80d003451b8e73ad74558eafde9 |
|
BLAKE2b-256 | c5169838a0d5ac8e3ff1af4891c8589bd0530a996ac984299c617110149e4796 |
File details
Details for the file scrapy_x-1.2-py3.6.egg
.
File metadata
- Download URL: scrapy_x-1.2-py3.6.egg
- Upload date:
- Size: 12.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f4bcd1c37b89f11826d180d2d0a879657770e91c0b91e846b96ae7c11663e69c |
|
MD5 | 8a7aafd1bd5cd0483c50600e9ede7029 |
|
BLAKE2b-256 | 9408d0786931c906ce189a4a10306091b9c794a88a49083b0d8cb0caaf32fa35 |
File details
Details for the file scrapy_x-1.2-py3-none-any.whl
.
File metadata
- Download URL: scrapy_x-1.2-py3-none-any.whl
- Upload date:
- Size: 6.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1014a218bc5f9a7edfd939fda40cc1f02befed531dc268ad8d02e06492ed2b5c |
|
MD5 | d4685f0c70b5f17ba86a5ec40f0ec68c |
|
BLAKE2b-256 | 44131c21e2aec36284d3619c24c3ad6e892dfc08001d9732f6ecd5cb970a037e |