Skip to main content

Scrapyd Dashboard

A dashboard specifically used for scrapyd servers to manipulate scrapy spiders (start, stop, check status).

Features

  • Scrapyd server status
  • Tasks (add, remove, list)
  • Authentification (Using the Django authentication system)
  • Scheduled tasks (add, remove, list)
  • View logs
  • Multiple independent user support
  • Task performance details

Demo

Demo website

Username: demo

Password: demo

Installing

  1. Install the package
pip install scrapyd_dash
  1. Add urls to your projects urls.py
from django.urls import include

urlpatterns = [
    ...
    path('scrapyd_dash/', include('scrapyd_dash.urls')),
]

Built With

  • Django - The web framework used.
  • ScrapyD - A service daemon to run Scrapy spiders.
  • LogParser - A tool for parsing Scrapy log files.

Authors

  • Dainius Preimantas - Initial work - Dainius-P

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b feature/fooBar)
  3. Commit your changes (git commit -am 'Add some fooBar')
  4. Push to the branch (git push origin feature/fooBar)
  5. Create a new Pull Request

License

This project is licensed under the MIT License - see the LICENSE file for details.

Release files for scrapyd-dash 0.1.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for scrapyd-dash 0.1.2
File Size Uploaded
scrapyd_dash-0.1.2.tar.gz 3.1 MB Details

Release files / scrapyd_dash-0.1.2.tar.gz

Download URL scrapyd_dash-0.1.2.tar.gz
Size 3.1 MB
Tags Source
SHA-256 checksum
How to use checksums
cf167e03d10cc7e7ea02f72c67e8ec29439de61192d9edcf5be9ca967c69a73e
BLAKE2b-256 checksum
How to use checksums
a6ffef44862316fe4820f475788eae7ea48b62bddbb97bbcd93ea4af132c30e0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.6.7

Release history Release notifications | RSS feed

This release

0.1.2 This release

1 release file

0.1.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page