DB-backed python logging.Handler subclass that uses kvlayer, and provides command-line tools.
Project description
dblogger
========
Provides two capabilities:
1) a subclass of python logging.Handler that stores logs using kvlayer
2) command line tools for searching through logs stored in kvlayer
Format
======
Logs are stored in kvlayer using the following format:
:key: UUID generated from the created field of the LogRecord class.
:value: JSON object with the LogRecord attributes except args and msg.
For more information have a look at Python LogRecord documentation.
http://docs.python.org/2/library/logging.html#logrecord-attributes
Usage
=====
Python
------
This is a small app in Python, an example of how to use dblogger.
import yaml
import logging
import kvlayer
from dblogger import DatabaseLogHandler, DBLoggerQuery
config = yaml.load(open("/myapp/config.yaml"))
client = kvlayer.client(config)
namespace = "myapp"
logger = logging.getLogger('mymodule')
logger.setLevel(logging.DEBUG)
dbhandler = DatabaseLogHandler(client, namespace)
logger.addHandler(dbhandler)
logger.warn("this is a demo msg")
Command Line
------------
After installing the python package, this command line entry point
will be available:
dblogger -c myconfig.yaml appname namespace loglevel filter
:filter: could be a regex to be applied to the log message or a field=regex pair,
specifying the log record field and the regex to be applied to that field.
Testing
=======
make test
Building
========
To build the module:
make
To create an egg package:
make build_egg
To create RPM packages:
make build_rpm
If you want to publish the package:
make register
and to clean everything:
make clean
TODO
====
- test rpm packge in a RPM platform.
- search from command line.
- 'tail -f' behavior for the log search interface.
========
Provides two capabilities:
1) a subclass of python logging.Handler that stores logs using kvlayer
2) command line tools for searching through logs stored in kvlayer
Format
======
Logs are stored in kvlayer using the following format:
:key: UUID generated from the created field of the LogRecord class.
:value: JSON object with the LogRecord attributes except args and msg.
For more information have a look at Python LogRecord documentation.
http://docs.python.org/2/library/logging.html#logrecord-attributes
Usage
=====
Python
------
This is a small app in Python, an example of how to use dblogger.
import yaml
import logging
import kvlayer
from dblogger import DatabaseLogHandler, DBLoggerQuery
config = yaml.load(open("/myapp/config.yaml"))
client = kvlayer.client(config)
namespace = "myapp"
logger = logging.getLogger('mymodule')
logger.setLevel(logging.DEBUG)
dbhandler = DatabaseLogHandler(client, namespace)
logger.addHandler(dbhandler)
logger.warn("this is a demo msg")
Command Line
------------
After installing the python package, this command line entry point
will be available:
dblogger -c myconfig.yaml appname namespace loglevel filter
:filter: could be a regex to be applied to the log message or a field=regex pair,
specifying the log record field and the regex to be applied to that field.
Testing
=======
make test
Building
========
To build the module:
make
To create an egg package:
make build_egg
To create RPM packages:
make build_rpm
If you want to publish the package:
make register
and to clean everything:
make clean
TODO
====
- test rpm packge in a RPM platform.
- search from command line.
- 'tail -f' behavior for the log search interface.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dblogger-0.4.14.tar.gz
(15.2 kB
view details)
Built Distribution
dblogger-0.4.14-py2.7.egg
(33.6 kB
view details)
File details
Details for the file dblogger-0.4.14.tar.gz
.
File metadata
- Download URL: dblogger-0.4.14.tar.gz
- Upload date:
- Size: 15.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f032727cc6c4b5ca6a89a69518afc7f4c0f23f8a93218a30f0bfdef4b764e946 |
|
MD5 | 348e9437680a60b2e991b65b0cbb8b25 |
|
BLAKE2b-256 | 5765d3a22f7c6bc1bd7eaedc0191c77b8cef0b31ebd48d8d3d484610e72cb977 |
File details
Details for the file dblogger-0.4.14-py2.7.egg
.
File metadata
- Download URL: dblogger-0.4.14-py2.7.egg
- Upload date:
- Size: 33.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 732da101039649591980f06e8de8dee0cbab212caa7f8570798d45daea82446f |
|
MD5 | 055f562892d382c0f0cd9f4745e156b7 |
|
BLAKE2b-256 | dda98b05d42a43666e958819d9ced01dc33477d4b51e6a3a00b2bf731792c02c |