ScrapydWeb: Full-featured web UI for monitoring and controlling Scrapyd servers cluster, with Scrapy log analysis and visualization supported
Features
-
Multinode Scrapyd Servers
- Group, filter and select any numbers of nodes
- Execute command on multinodes with one click
-
Scrapy Log Analysis
- Stats collection
- Progress visualization
- Logs categorization
-
All Scrapyd API Supported
- Deploy project, Run Spider, Stop job
- List projects/versions/spiders/running_jobs
- Delete version/project
-
Others
- Basic auth for web UI
Maintainer
Installation
To install ScrapydWeb, simply use pip:
$ pip install scrapydweb
Start Up
Run "scrapydweb -h" to get help, and a config file named "scrapydweb_settings.py" would be copied to the working directory, then you can custom config with it.
$ scrapydweb
Visit http://127.0.0.1:5000
Screenshot
-
Overview
-
Dashboard
-
Log Analysis
-
Stats collection
-
Progress visualization
-
Logs categorization
-
-
Deploy Project
-
Run Spider
-
Manage Projects
1 maintainer
Metadata
1 maintainer
Release files for scrapydweb 0.9.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| scrapydweb-0.9.5.tar.gz | 575.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| scrapydweb-0.9.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 1.2 MB
Release files / scrapydweb-0.9.5.tar.gz
| Download URL | scrapydweb-0.9.5.tar.gz |
|---|---|
| Size | 575.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c355c94c7cb663e6d2463b756c1d68bea31bafcfa2d9581e5bb5fa7b60f47a44
|
|
BLAKE2b-256 checksum How to use checksums |
745f4af457634717b7f91dcef968c92765ebeebc7ffb5326b163563f5fe0d962
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.2.0 requests-toolbelt/0.8.0 tqdm/4.25.0 CPython/3.6.5
|
Release files / scrapydweb-0.9.5-py3-none-any.whl
| Download URL | scrapydweb-0.9.5-py3-none-any.whl |
|---|---|
| Size | 602.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
dde52b9b6cd2119dc977b8c60fb533bd901657523316a1b93f3e2b0796c671b7
|
|
BLAKE2b-256 checksum How to use checksums |
2fcfba3f64036cde7c0202cae827f4b8e53b245b7760c6eee63761cc951e096e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.2.0 requests-toolbelt/0.8.0 tqdm/4.25.0 CPython/3.6.5
|
