Skip to main content

Very basic python logstash shipper

Project description

PyPI version ### Description

This is very simple replacement for ElasticSearch filebeat.

Usage

install

pip install git+https://github.com/stavinsky/lsshipper

after that create config directory anywhere you want and put 2 config files there.

  1. log_config.ini - this is config for logging system. example with verbose logs
  2. config.ini - main config. Make sure that pattern and newline parameters is doublequotted. example with verbose logs

running

It can be started as a module:

python -m lsshipper --config_dir <dir with configs>

Why?

There is windows software that adds preallocated block of zeroes(\x00) to log file. Original filebeat skips such blocks. So big part of logs can be lost.

Speed

On my mac mini late 2003 it can write to network about 2Mb/s. I will test later on windows and linux. I believe on linux it should be much faster.

Problems

  1. On very fast server reconnects it can loose one log string. Please check test_connection.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for lsshipper, version 0.1.8
Filename, size File type Python version Upload date Hashes
Filename, size lsshipper-0.1.8.tar.gz (8.0 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page