a scrapy subcommand for easily enqueuing crawling jobs in a scalable and high performance way
Project description
Overview
- A distributed, scalable and lightweight environment for deploying and running scrapy spiders/projects with no-hassle on commodity hardware, also it is compatible with scrapyd /schedule.json and /daemonstatus.json
, for more info go there: https://github.com/alash3al/scrapy-x
Install
The quick way:
pip install scrapy-x
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-x-1.8.tar.gz
(9.9 kB
view details)
Built Distribution
File details
Details for the file scrapy-x-1.8.tar.gz.
File metadata
- Download URL: scrapy-x-1.8.tar.gz
- Upload date:
- Size: 9.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | eb692174c00b12c0261fd737eea5c89674dcaa63a22e71f9bc58ef004950bd7a |
|
| MD5 | 895a5a01235e629aafa96e6b5cb52c30 |
|
| BLAKE2b-256 | 6d93556532aad8395dd1e0b6af103204ac4edabfb059a603c9522182f7f1216a |
File details
Details for the file scrapy_x-1.8-py3-none-any.whl.
File metadata
- Download URL: scrapy_x-1.8-py3-none-any.whl
- Upload date:
- Size: 7.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.6.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | cbd82224def82b936aeb48a63b81a3a901c0155e11464a170c863c0778a7e46a |
|
| MD5 | a5098c42c6a20608b823fe080c275624 |
|
| BLAKE2b-256 | 1cb7a0c3664272735333cf0cdf0f20dfd0ee2e6589e233fb450d6d205cbb69df |
