Very basic python logstash shipper
Project description
This is very simple replacement for ElasticSearch filebeat.
Usage
install
pip install git+https://github.com/stavinsky/lsshipper
after that create config directory anywhere you want and put 2 config files there.
log_config.ini - this is config for logging system. example with verbose logs
config.ini - main config. Make sure that pattern and newline parameters is doublequotted. example with verbose logs
running
It can be started as a module:
python -m lsshipper --config_dir <dir with configs>
Why?
There is windows software that adds preallocated block of zeroes(\x00) to log file. Original filebeat skips such blocks. So big part of logs can be lost.
Speed
On my mac mini late 2003 it can write to network about 2Mb/s. I will test later on windows and linux. I believe on linux it should be much faster.
Problems
On very fast server reconnects it can loose one log string. Please check test_connection.py
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.