Skip to main content
This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (pypi.python.org).
Help us improve Python packaging - Donate today!

Ingests log files into Graphite where they can be visualized.

Project Description

Overview

Graphite Log Feeder (GLF) is a generic tool that can parse application log files, extract meaningful data, and forward it to Graphite for visualizing. There is a parser included for ingesting data from The Grinder. This parser can be used as the basis for creating other parsers (for Apache, Scribe, your own application, or whatever.)

There is a similar tool – Logster – which also feeds log data to Graphite. However, Logster only supports realtime log analysis, whereas glf only supports non-realtime analysis, making the two tools complimentary.

Installation

GLF is installed via pip.

pip install graphite_log_feeder

Once pip has installed glf, you will need to generate a config file, and edit it to be suitable for your environment. Glf comes with a command-line option to generate a sample config file

graphite_log_feeder.py -e

This will generate a file named ‘glf.sample.conf’ which you can use as the basis for creating your own configuration.

There must be a running installation of Graphite on your network for GLF to forward data to. See the Graphite web site for details on setting up and configuring Graphite

http://graphite.wikidot.com/

Usage

(after adjusting the values in your sample config file to be appropriate for your environment)

graphite_log_feeder.py  <config_file>

Additional Resources

Java/JMX counters and application-level metrics can be fed to Graphite using the JMXTrans tool:

http://code.google.com/p/jmxtrans/

OS-level metrics (CPU, mem, etc.) can be fed to Graphite via quickstatd or collectd (with graphite plugin)

https://bitbucket.org/travis_bear/quickstatd

Release History

Release History

This version
History Node

0.7.6

History Node

0.7.5

History Node

0.7.4

History Node

0.7.3

History Node

0.7.2

History Node

0.7.1

History Node

0.7.0

Download Files

Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

File Name & Checksum SHA256 Checksum Help Version File Type Upload Date
graphite_log_feeder-0.7.6.tar.gz (17.7 kB) Copy SHA256 Checksum SHA256 Source Feb 15, 2013

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting