Skip to main content

A dashboard for scrapy project using scrapyd and logparser

Project description

Scrapyd Dashboard

A dashboard specifically used for scrapyd servers to manipulate scrapy spiders (start, stop, check status).

Features

  • Scrapyd server status
  • Tasks (add, remove, list)
  • Authentification (Using the Django authentication system)
  • Scheduled tasks (add, remove, list)
  • Multi user support
  • Task performance details

Demo

Demo website

Installing

  1. Install the package
pip install scrapyd_dash
  1. Add urls to your projects urls.py
from django.urls import include

urlpatterns = [
    ...
    path('scrapyd_dash/', include('scrapyd_dash.urls')),
]

Built With

  • Django - The web framework used
  • ScrapyD - A service daemon to run Scrapy spiders

Authors

  • Dainius Preimantas - Initial work - Dainius-P

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b feature/fooBar)
  3. Commit your changes (git commit -am 'Add some fooBar')
  4. Push to the branch (git push origin feature/fooBar)
  5. Create a new Pull Request

License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapyd_dash-0.1.1.tar.gz (3.1 MB view details)

Uploaded Source

File details

Details for the file scrapyd_dash-0.1.1.tar.gz.

File metadata

  • Download URL: scrapyd_dash-0.1.1.tar.gz
  • Upload date:
  • Size: 3.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.6.7

File hashes

Hashes for scrapyd_dash-0.1.1.tar.gz
Algorithm Hash digest
SHA256 54a2dfb770ae96db203a165aefeab1675aa791512cc4fbabdc1a73d58481891d
MD5 f353b4e4570ffd2bae3f28c7cbbfcfce
BLAKE2b-256 d45c2f164ad46b02dc03fce73c66cb14309d1c5ce3c7f4b7e7bf89a985135023

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page