Skip to main content

Advanced Persistent Error Log

Project description

collective.logbook

Author:Ramon Bartl
Version:0.9.0

collective.logbook add-on provides advanced persistent error logging for the open source Plone CMS.

Introduction

For anonymous users Plone generates an Error Page, which contains an error number. But what to do with this error number?

You have to log into your plone site, go to the ZMI, check the error_log object and probably construct the url by hand to get the proper error with this error number, e.g.:

http://localhost:8080/Plone/error_log/showEntry?id=1237283091.10.529903983894

If you are lucky, you will find the error by this number for further investigation. If not, then maybe number of occured errors have exceeded the number of exceptions to keep, or you are on the wrong Zope instance if you run a cluster setup with a ZEO server, or maybe the Zope instance was restarted in between, which caused a reset of all logged errors.

Not really smooth this behaviour.

Would it not be better to have a nice frontend where you can paste the error number to a field and search for it? Keep all logged error messages persistent, also when Zope restarts? Keep only unique errors and not a thousand times the same Error? Get an email notification when a new, unique error occured, so that you know already what’s going on before your client mails this error number to you?

If you think that this would be cool, collective.logbook is what you want.

Quickstart

After installation, you can configure your logbook settings in the controlpanel:

http://localhost:8080/Plone/@@logbook-controlpanel

All occured errors get listed in the logbook view:

http://localhost:8080/Plone/@@logbook

As the logbook view diplays real errors that occured in your Plone site, it will probably be empty at the first time.

To raise an error by intent, collective.logbook ships with two URL routes, that do this job for you for testing purpose:

http://localhost:8080/Plone/@@error-test

This will raise an expected RuntimeError, which should be logged in the logbook view. Calling this URL multiple times, should reference the error, because of the same error signature.

This means, if you have configured Email notification, you will just be notified once. The same is true for the webhooks, which will be described later.

To simulate different errors, you can browse this URL:

http://localhost:8080/Plone/@@random-error-test

This raises different errors, and multiple calls to this URL fills up the logbook view with the occured errors, sorted by the most often happened errors or to be more precisely, the errors that are referenced most often appear first.

Web hooks

collective.logbook provides ability to HTTP POST error message to any web service when an error happens in Plone. This behavior is called a web hook.

Use cases

In Site Setup > Logbook you can enter URLs where HTTP POST will be asynchronously performed on a traceback. HTTP POST payload is an message from Logbook, containing a link for further information.

Note

Currently repeated errros (same traceback signature, which get referenced in logbook) are not POST’ed again. You will receive a message only once, unless you clear logbook contents in the @@logbook management view.

Installation

These instructions assume that you already have a Plone buildout that’s built and ready to run.

Edit your buildout.cfg file and look for the eggs key in the instance section. Add collective.logbook to that list. Your list will look something like this:

eggs =
    ...
    collective.logbook

Run buildout.

Activate the add-on via Site Setup > Add ons.

Compatibility

This extension works with Plone 4 and Plone 5.

Browser Testing

With collective.logbook enabled, it is simple to see all errors occured in your Plone site:

>>> portal = self.getPortal()
>>> browser = self.getBrowser()
>>> browser.addHeader('Authorization', 'Basic admin:secret')

Remember some URLs:

>>> portal_url = portal.absolute_url()
>>> logbook_controlpanel_url = portal_url + "/@@logbook-controlpanel"
>>> logbook_test_error_url = portal_url + "/@@error-test"
>>> logbook_url = portal_url + "/@@logbook"

Browse to the @@logbook view:

>>> browser.open(logbook_url)
>>> 'Congratulations, there are 0 Errors in your Plone Site!' in browser.contents
True

Now lets create an error with the @@error-test view, which raises an expected RuntimeError:

>>> browser.open(logbook_test_error_url)
Traceback (most recent call last):
...
HTTPError: HTTP Error 500: Internal Server Error

>>> browser.open(logbook_url)
>>> "There are 1 saved (unique) Tracebacks and 0 referenced Tracebacks" in browser.contents
True

The same error will be referenced and not logged again:

>>> browser.open(logbook_test_error_url)
Traceback (most recent call last):
...
HTTPError: HTTP Error 500: Internal Server Error

>>> browser.open(logbook_url)
>>> "There are 1 saved (unique) Tracebacks and 1 referenced Tracebacks" in browser.contents
True

There is also a @@random-error-test view, which randomly selects different tracebacks for testing.

Logbook logging can be deactivated on purpose in the @@logbook-controlpanel view:

>>> browser.open(logbook_controlpanel_url)
>>> browser.getControl(name="form.widgets.logbook_enabled:list").value = []
>>> browser.getControl(name="form.buttons.save").click()

Errors should not be logged anymore:

>>> browser.open(logbook_test_error_url)
Traceback (most recent call last):
...
HTTPError: HTTP Error 500: Internal Server Error

>>> browser.open(logbook_url)
>>> "There are 1 saved (unique) Tracebacks and 1 referenced Tracebacks" in browser.contents
True

Finally, we remove all errors:

>>> browser.open(logbook_url)
>>> browser.getControl(name="form.button.deleteall").click()
>>> 'Congratulations, there are 0 Errors in your Plone Site!' in browser.contents
True

Technical Details

This section gives an overview how collective.logbook works.

SiteErrorLog Patch

collective.logbook patches the raising method of Products.SiteErrorLog.SiteErrorLog:

from Products.SiteErrorLog.SiteErrorLog import SiteErrorLog

_raising = SiteErrorLog.raising

def raising(self, info):
    enty_url = _raising(self, info)
    notify(ErrorRaisedEvent(self, enty_url))
    return enty_url

The patch fires an ErrorRaisedEvent event before it returns the enty_url. The entry url is the link to the standard SiteErrorLog like:

http://localhost:8080/Plone/error_log/showEntry?id=1237283091.10.529903983894

The patch gets _only_ then installed, when you install collective.logbook over the portal_quickinstaller tool and removes the patch, when you uninstall it.

You can also deactivate the patch over the logbook configlet of the plone control panel.

Log Storage

The default storage is an annotation storage on the plone site root:

<!-- default storage adapter -->
<adapter
    for="*"
    factory=".storage.LogBookStorage"
  />

The default storage adapter creates 2 PersistentDict objects in your portal. One ‘main’ storage and one ‘index’ storage, which keeps track of referenced errors.

The storage will be fetched via an adapter lookup. So the more specific adapter will win. Maybe an SQL storage with SQLAlchemy would be nice here:)

Notify Event

When a new unique error occurs, an INotifyTraceback event gets fired. An email event handler is already registered with collective.logbook:

<subscriber
    for=".interfaces.INotifyTraceback"
    handler=".events.mailHandler"
  />

This handler will email new tracebacks to the list of email adresses specified in the logbook configlet of the plone control panel.

Configuration

collective.logbook now uses Plone 5’s registry to store its configuration. It has 3 configuration keys:

  • logbook.logbook_log_mails
  • logbook.logbook_large_site
  • logbook.logbook_webhook_urls

These properties take the values you enter in logbook configlet in the plone control panel.

The first one is used to email new tracebacks to these email addresses.

The second one changes some behaviour for large sites.

The third one does an HTTP POST to some URLs when an error occurs.

Changelog

0.9.1 (2018-07-17)

  • Fix #17 by making sure the context of a log entry is not acquisition-wrapped. [rafaelbco]

0.9.0 (2017-02-23)

  • Fix #11 by adding upgrade step to create registry records. [rafaelbco]
  • Fix #12: Error while trying to login into the ZMI. [rafaelbco]

0.8 (2017-01-27)

  • Complete Code Rework, Cleanup and Refactoring for Plone 4/5 Compatibility. [ramonski]
  • add Plone 5.0 pypi classifier, update README.rst to mention Plone 5 compatibility [tkimnguyen]

0.8b2 (2016-10-24)

  • Cleanup/doc update for Plone 5 version [glemignot]

0.8b1 (2016-10-21)

  • Initial port to Plone 5 [glemignot]

0.7 (2014-06-12)

  • Fixed tests [ramonski]
  • Add Plone4.3-compatibility. [WouterVH]
  • Added Web Hook support [miohtama, sevanteri]

0.6 (2011-11-28)

  • Log exceptions within exception handler [jfroche]
  • Move delete all button, add show all button, show error message if error was not found. [jfroche]
  • Add option that disable browsing stored errors. This option become useful if you have a site with many errors. [jfroche]

0.5 (2011-08-16)

  • Move storage to OOBTree to avoid that logging error transactions get bigger and bigger. Add upgradehandler accordingly. [gotcha]
  • Fix saving configuration. [gotcha]
  • Logging initialization at startup time was broken with Zope 2.13 at least. [gotcha]
  • Added support for i18n [macagua]
  • Added support for Spanisn translation [macagua]
  • Move the mail notifier into a view to use a template for better HTML email handling. [rossp]
  • Include the REQUEST HTML for more useful debugging and troubleshooting. [rossp]

0.4 (2010-08-02)

0.3.1 (2009-03-18)

  • the error handler now starts a new transaction before saving it into the logbook [ramonski]

0.3 (2009-03-17)

  • 0.2 release was broken, sorry for this re-release [ramonski]
  • fixed issues which caused some ugly Database Conflict errors [ramonski]
  • removed all Zope2.app() stuff [ramonski]
  • mail handler stops when no emails specified [ramonski]
  • fixed uninstall method of properties [ramonski]

0.2 (2009-03-17)

  • added a configlet for plone control panel [ramonski]
  • added a default notify traceback email handler [ramonski]
  • added propert install/uninstall methods for the SiteErrorLog patch [ramonski]
  • added 2 properties in the application root [ramonski]

0.1 - Unreleased

  • Initial release [ramonski]

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for collective.logbook, version 0.9.1
Filename, size File type Python version Upload date Hashes
Filename, size collective.logbook-0.9.1.tar.gz (37.2 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page