pdlogger 0.0.3

An example package

pdlogger

pdlogger is a python based logger that let's you push your logging.info() calls to an AMQP queue.

Installation

pdlogger is available on pypi. Just do:

pip install pdlogger

Usage

Client application

Once you have installed pdlogger, setup the logger in the initial steps of your application by doing:

import logging
from pdlogger.Logging import AMQPLoggingHandler
from pdlogger.Logging import AMQPLogger
from pdlogger.Logging import EnvVarChecker


logging.setLoggerClass(AMQPLogger)
logger = logging.getLogger("pdlogs")
logger.setLevel(logging.INFO)
handler = AMQPLoggingHandler()
formatter = logging.Formatter('%(asctime)s %(levelname)s %(message)s')
handler.setFormatter(formatter)
logger.addHandler(handler)

Then, in all other modules of your application, just do

import logging
logger = logging.getLogger('pdlogs')
logger.info(<your data here>)

You can either set AMQP_URL, QUEUE_NAME in the environment variables, or they can be passed to the AMQPLoggingHandler like:

AMQPLoggingHandler(amqp_url, queue_name, msg_priority)

logger.info takes the following arguments:

• msg: Logs that you want to push. Anything that is JSON serializable goes.
• project_id (Optional): Project ID. Can be left None. E.g. hf38fgf883fg3bs3
• test_image_id (Optional): Test Image ID. Can be left None. E.g. 73184492
• application_name (Optional): Application Name. Can be left None. E.g. all-in-1
• checkpoint_name: Arbitrary string to keep track of where the log is coming from. E.g. opensetThreshApplied, otherRemoved.

Producer

You need atleast 1 consumer running to consume the logs. To run a consumer application, just run:

from pdlogger.Logging import AMQPConsumer
consumer = AMQPConsumer()
consumer.start_consuming()

You can either set AMQP_URL, QUEUE_NAME, SQL_HOST, SQL_USER, SQL_PASSWORD, SQL_DATABASE in the environment variables, or they can be passed to the AMQPConsumer like:

AMQPConsumer(amqp_url, queue_name, sql_host, sql_user, sql_password, sql_database)