Skip to main content

Very basic python logstash shipper

Project description

PyPI version ### Description

This is very simple replacement for ElasticSearch filebeat.

Usage

install

pip install git+https://github.com/stavinsky/lsshipper

after that create config directory anywhere you want and put 2 config files there.

  1. log_config.ini - this is config for logging system. example with verbose logs

  2. config.ini - main config. Make sure that pattern and newline parameters is doublequotted. example with verbose logs

running

It can be started as a module:

python -m lsshipper --config_dir <dir with configs>

Why?

There is windows software that adds preallocated block of zeroes(\x00) to log file. Original filebeat skips such blocks. So big part of logs can be lost.

Speed

On my mac mini late 2003 it can write to network about 2Mb/s. I will test later on windows and linux. I believe on linux it should be much faster.

Problems

  1. On very fast server reconnects it can loose one log string. Please check test_connection.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lsshipper-0.1.5.tar.gz (7.9 kB view details)

Uploaded Source

File details

Details for the file lsshipper-0.1.5.tar.gz.

File metadata

  • Download URL: lsshipper-0.1.5.tar.gz
  • Upload date:
  • Size: 7.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for lsshipper-0.1.5.tar.gz
Algorithm Hash digest
SHA256 8733f158c2fc485fc2aa314e225a8ebf65827ddb8f6cce7f357d3b03a814643f
MD5 4ded30bbc3a1eac14d32b6a64f4c6c5f
BLAKE2b-256 2cc12995671bc92477054f7213fdc435750e3ce5426532a276ab9fd73246f2ab

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page