Skip to main content

Nonblocking Logging Handler for Python Logging

Project description

Nonblocking Log Handler
-----------------------

Provides a NonblockingLogHandler class consistent with the Python logging
subsystem.

This handler acts as a proxy for the another log handler that may be slow
to execute: e.g. the SMTPHandler, SocketHandler, SysLogHandler - especially
when they are talking to remote servers.

If you have a real-time system (i.e. one where a late response is a wrong
response) and you are sending log messages via email, http, syslog, etc.,
you should consider using this module to protect against unexpected delays.

It is intended to be a drop-in replacement (see provisos below) for your
proxied handler. Unlike the proxied handler, this handler which returns
quickly, and executes the actually logging in the background, in a separate
thread.

Provisos:

* If you pass an objects to the logging functions, be aware that their
__str__() functions should be fast. I/O bound str() calls are outside the
scope of this module.

Execution of str() functions on message parameters and string formatting
is done immediately, in the calling thread. This is to guarantee both
the thread-safety of the logged objects and also that the log shows the
object's values at the time of the call, not the time of the emit.

* If you subclass from Formatter, note that it will not have the user
parameters from the logging call passed to it. It will only receive the
resulting message string formatted according to the client's wishes. It
can still format dates, threadnames, levels, etc.

* If you subclass from Filter, be aware that they should be fast. I/O-bound
filters are outside of the scope of this module.

* Clients should not directly call format() or emit() on the
NonblockingLogHandler class. Consider them private.

* Once the NonblockingLogHandler handler is initialised, any further calls
to setLevel(), addFilter and removeFilter() made on the delegated handler
are ignored by the proxy handler. Conversely, the delegated handler is
not informed of calls made on the NonblockingLogHandler instance.

Best practice would be to only update the NonblockingLogHandler handler,
and not use the values stored in the delegated handler.

* If the close() method is called on the NonblockingLogHandler handler,
it does *not* call close on the delegated handler, in case you are using
it elsewhere in the application. This makes it difficult to ever call
close() on the delegated handler, becausse it may still be in use.

Example usage:
nonblocking_email_handler = nonblockingloghandler.NonblockingLogHandler(
logging.SMTPHandler(
"localhost", "logging_system@example.com",
"admin@example.com", "Log message")
)
db_logger = logging.getLogger("database")
database_logger.addHandler(nonblocking_email_handler)

# This operation will return immediately, before email is sent.
db_logger.critical("Database corrupted")

nonblocking_email_handler.close()

Limitations:

* Only tested on Python 2.7.2, Windows and Ubuntu
* Let me know if there is demand for other versions.
* Known to have a rare intermittent shut-down race condition on Windows
only.
* Results in exception report being displayed to screen:
"Exception in thread NonblockingLogHandler.[...] (most likely raised
during interpreter shutdown)"
* Suspected (unconfirmed) cause Python run-time bug, fixed in Python 3.2.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nonblockingloghandler-1.1.0a6.zip (37.3 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

nonblockingloghandler-1.1.0a6.win32.zip (13.8 kB view details)

Uploaded Source

nonblockingloghandler-1.1.0a6.win32.exe (208.6 kB view details)

Uploaded Source

nonblockingloghandler-1.1.0a6-py2.7.egg (13.0 kB view details)

Uploaded Egg

File details

Details for the file nonblockingloghandler-1.1.0a6.zip.

File metadata

File hashes

Hashes for nonblockingloghandler-1.1.0a6.zip
Algorithm Hash digest
SHA256 4e7bade135678eb4df6f0b3a7e29f1f5c677cf8ea0f8c5fa0e5781c8990d8469
MD5 5bacd68218734899fe24468ebbbf0f8b
BLAKE2b-256 18536d1d6f5663671c101426cebd6aada40eea6fd46543b85498ade07b696207

See more details on using hashes here.

File details

Details for the file nonblockingloghandler-1.1.0a6.win32.zip.

File metadata

File hashes

Hashes for nonblockingloghandler-1.1.0a6.win32.zip
Algorithm Hash digest
SHA256 f545f137d8a93c3fde7357fd83eb4d7d7749753b29ee3c07ebdc92479f87773d
MD5 0b24c235b7c7090181900ecbba83a646
BLAKE2b-256 b39a6ada88855e4539a3721f7fe8789256f0d2259356df3457dc70049eb83abf

See more details on using hashes here.

File details

Details for the file nonblockingloghandler-1.1.0a6.win32.exe.

File metadata

File hashes

Hashes for nonblockingloghandler-1.1.0a6.win32.exe
Algorithm Hash digest
SHA256 e6b06323d5a2e373d5e0ff22f76402c6cf636ed643394d4153c29322ed40d3b6
MD5 fece00b6461daa49536b9d53720b65be
BLAKE2b-256 a31eeaf6c23c3cc55671649232501b7f4aaf8ca2d0e2e33f422df2292fc9a62b

See more details on using hashes here.

File details

Details for the file nonblockingloghandler-1.1.0a6-py2.7.egg.

File metadata

File hashes

Hashes for nonblockingloghandler-1.1.0a6-py2.7.egg
Algorithm Hash digest
SHA256 4301301a431bcbb26a99c867bc7f53fc82a57e36c594b250bf38e850a584b9ba
MD5 f95980794ded45fbf8948adc8543aa57
BLAKE2b-256 e6076e40287137bac340b8712b24432fb47ad31bc0b973c469a135976137dc01

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page