Skip to main content
Help us improve Python packaging – donate today!

reusable django app to log crawlers hitting many 404 pages.

Project Description

Django Brokenlinks
==================

log brokenlinks to logfile and config fail2ban to ban crawlers hitting many 404 pages.

Requirements
------------

`django-appconf`


Installation
------------

::

$ pip install django-brokenlinks


Setup
-----

1. Add ``'brokenlinks'`` to INSTALLED_APPS
2. Add ``'brokenlinks.middleware.BrokenLinkEmailsMiddleware'`` to ``MIDDLEWARE_CLASSES``
3. Set the ``BROKENLINKS_LOG_PATH``
4. After change in brokenlinks configs run ``manage.py createbrokenlinksconfs`` once and use the result conf-files with fail2ban

your settings.py will look like below:


INSTALLED_APPS = (
# ...
'brokenlinks',
# ...
)

MIDDLEWARE_CLASSES= (
'brokenlinks.middleware.BrokenLinkEmailsMiddleware',
# ...
)

BROKENLINKS_LOG_PATH = '/path/to/brokenlinks.log'


then config fail2ban to use it


Author
-----

* w.Tayyeb

Release history Release notifications

This version
History Node

0.1.1

History Node

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
django_brokenlinks-0.1.1-py2-none-any.whl (7.0 kB) Copy SHA256 hash SHA256 Wheel 2.7 Nov 20, 2016

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page