syslog-ng mod-python Kafka driver
Project description
**syslog-ng Apache Kafka destination**
.. image:: https://img.shields.io/pypi/v/syslogng_kafka.svg
:target: https://pypi.python.org/pypi/syslogng_kafka
.. image:: https://travis-ci.org/ilanddev/syslogng_kafka.svg?branch=master
:target: https://travis-ci.org/ilanddev/syslogng_kafka
.. image:: https://readthedocs.org/projects/syslogng_kafka/badge/?version=latest
:target: https://syslogng_kafka.readthedocs.org/en/latest/
:alt: Documentation Status
.. image:: https://requires.io/github/ilanddev/syslogng_kafka/requirements.svg?branch=master
:target: https://requires.io/github/ilanddev/syslogng_kafka/requirements/?branch=master
:alt: Requirements Status
- Free software: Apache Software License 2.0
- Documentation: https://syslogng-kafka.readthedocs.io.
============
Introduction
============
**syslogng_kafka** provides a `Python`_ module for `syslog-ng`_ >= 3.7 allowing one
to filter and forward syslog messages to `Apache Kafka`_ brokers.
The implementation leverages `confluent-kafka`_ which uses the awesome `librdkafka`_
library providing reliability and high performance.
**Please read the** `doc`_ **as in most cases a `pip install` won't work as they are particular requirements that are currently not met by mainstream Linux distribution.**
.. _Python: https://www.python.org/
.. _syslog-ng: https://github.com/balabit/syslog-ng
.. _Apache Kafka: http://kafka.apache.org/
.. _doc: https://syslogng-kafka.readthedocs.io
.. _confluent-kafka: https://github.com/confluentinc/confluent-kafka-python
.. _librdkafka: https://github.com/edenhill/librdkafka
=======
History
=======
0.1.6 (2017-07-04)
------------------
* Disable `delivery.report.ony.error` on callbacks because of a bug in
`confluent-kafka`: https://github.com/confluentinc/confluent-kafka-python/issues/84
Let's revisit when 0.11 is released.
0.1.5 (2017-07-03)
------------------
* provide a global `on_delivery` callback in the `Producer()` config
dict better for memory consumptions vs per message callback.
0.1.4 (2017-06-30)
------------------
* make `send` more robust
0.1.3 (2017-06-30)
------------------
* catch `UnicodeEncodeError` in `send()`
0.1.2 (2017-06-29)
------------------
* catch `UnicodeDecodeError` in delivery callback as it can be thrown by
`err.str()`
0.1.1 (2017-06-29)
------------------
* add util to produce syslog messages in `tools` sub-folder
* remove useless `KeyboardInterrupt`
* reduce timeout of `flush()` from 30 to 5 seconds
* more tests
0.1.0 (2017-06-28)
------------------
* First release on PyPI.
.. image:: https://img.shields.io/pypi/v/syslogng_kafka.svg
:target: https://pypi.python.org/pypi/syslogng_kafka
.. image:: https://travis-ci.org/ilanddev/syslogng_kafka.svg?branch=master
:target: https://travis-ci.org/ilanddev/syslogng_kafka
.. image:: https://readthedocs.org/projects/syslogng_kafka/badge/?version=latest
:target: https://syslogng_kafka.readthedocs.org/en/latest/
:alt: Documentation Status
.. image:: https://requires.io/github/ilanddev/syslogng_kafka/requirements.svg?branch=master
:target: https://requires.io/github/ilanddev/syslogng_kafka/requirements/?branch=master
:alt: Requirements Status
- Free software: Apache Software License 2.0
- Documentation: https://syslogng-kafka.readthedocs.io.
============
Introduction
============
**syslogng_kafka** provides a `Python`_ module for `syslog-ng`_ >= 3.7 allowing one
to filter and forward syslog messages to `Apache Kafka`_ brokers.
The implementation leverages `confluent-kafka`_ which uses the awesome `librdkafka`_
library providing reliability and high performance.
**Please read the** `doc`_ **as in most cases a `pip install` won't work as they are particular requirements that are currently not met by mainstream Linux distribution.**
.. _Python: https://www.python.org/
.. _syslog-ng: https://github.com/balabit/syslog-ng
.. _Apache Kafka: http://kafka.apache.org/
.. _doc: https://syslogng-kafka.readthedocs.io
.. _confluent-kafka: https://github.com/confluentinc/confluent-kafka-python
.. _librdkafka: https://github.com/edenhill/librdkafka
=======
History
=======
0.1.6 (2017-07-04)
------------------
* Disable `delivery.report.ony.error` on callbacks because of a bug in
`confluent-kafka`: https://github.com/confluentinc/confluent-kafka-python/issues/84
Let's revisit when 0.11 is released.
0.1.5 (2017-07-03)
------------------
* provide a global `on_delivery` callback in the `Producer()` config
dict better for memory consumptions vs per message callback.
0.1.4 (2017-06-30)
------------------
* make `send` more robust
0.1.3 (2017-06-30)
------------------
* catch `UnicodeEncodeError` in `send()`
0.1.2 (2017-06-29)
------------------
* catch `UnicodeDecodeError` in delivery callback as it can be thrown by
`err.str()`
0.1.1 (2017-06-29)
------------------
* add util to produce syslog messages in `tools` sub-folder
* remove useless `KeyboardInterrupt`
* reduce timeout of `flush()` from 30 to 5 seconds
* more tests
0.1.0 (2017-06-28)
------------------
* First release on PyPI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
syslogng_kafka-0.1.6.tar.gz
(26.8 kB
view hashes)
Built Distribution
Close
Hashes for syslogng_kafka-0.1.6-py2-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ec6f24391ae1e6e040ae0f26242649db0c91cbfd439b148c4f587bfdfa97b93 |
|
MD5 | c0a41294a2f91615a10c9b6387905ced |
|
BLAKE2b-256 | 70d526afb1acae0b64e3ee79e6e9c7a3420f6c696a4f4deb0e0b351416fc73d0 |