Skip to main content

DB-backed python logging.Handler subclass that uses kvlayer, and provides command-line tools.

Project description

dblogger
========

Provides two capabilities:

1) a subclass of python logging.Handler that stores logs using kvlayer

2) command line tools for searching through logs stored in kvlayer



Format
======

Logs are stored in kvlayer using the following format:

:key: UUID generated from the created field of the LogRecord class.
:value: JSON object with the LogRecord attributes except args and msg.

For more information have a look at Python LogRecord documentation.
http://docs.python.org/2/library/logging.html#logrecord-attributes


Usage
=====

Python
------

This is a small app in Python, an example of how to use dblogger.

import yaml
import logging
import kvlayer
from dblogger import DatabaseLogHandler, DBLoggerQuery

config = yaml.load(open("/myapp/config.yaml"))
client = kvlayer.client(config)
namespace = "myapp"

logger = logging.getLogger('mymodule')
logger.setLevel(logging.DEBUG)
dbhandler = DatabaseLogHandler(client, namespace)
logger.addHandler(dbhandler)

logger.warn("this is a demo msg")



Command Line
------------

After installing the python package, this command line entry point
will be available:

dblogger -c myconfig.yaml appname namespace loglevel filter

:filter: could be a regex to be applied to the log message or a field=regex pair,
specifying the log record field and the regex to be applied to that field.


Testing
=======

make test

Building
========

To build the module:

make

To create an egg package:

make build_egg

To create RPM packages:

make build_rpm

If you want to publish the package:

make register

and to clean everything:

make clean


TODO
====

- test rpm packge in a RPM platform.
- search from command line.
- 'tail -f' behavior for the log search interface.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dblogger-0.4.14.tar.gz (15.2 kB view details)

Uploaded Source

Built Distribution

dblogger-0.4.14-py2.7.egg (33.6 kB view details)

Uploaded Source

File details

Details for the file dblogger-0.4.14.tar.gz.

File metadata

  • Download URL: dblogger-0.4.14.tar.gz
  • Upload date:
  • Size: 15.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for dblogger-0.4.14.tar.gz
Algorithm Hash digest
SHA256 f032727cc6c4b5ca6a89a69518afc7f4c0f23f8a93218a30f0bfdef4b764e946
MD5 348e9437680a60b2e991b65b0cbb8b25
BLAKE2b-256 5765d3a22f7c6bc1bd7eaedc0191c77b8cef0b31ebd48d8d3d484610e72cb977

See more details on using hashes here.

File details

Details for the file dblogger-0.4.14-py2.7.egg.

File metadata

File hashes

Hashes for dblogger-0.4.14-py2.7.egg
Algorithm Hash digest
SHA256 732da101039649591980f06e8de8dee0cbab212caa7f8570798d45daea82446f
MD5 055f562892d382c0f0cd9f4745e156b7
BLAKE2b-256 dda98b05d42a43666e958819d9ced01dc33477d4b51e6a3a00b2bf731792c02c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page