Skip to main content

Very basic python logstash shipper

Project description

PyPI version ### Description

This is very simple replacement for ElasticSearch filebeat.

Usage

install

pip install git+https://github.com/stavinsky/lsshipper

after that create config directory anywhere you want and put 2 config files there.

  1. log_config.ini - this is config for logging system. example with verbose logs

  2. config.ini - main config. Make sure that pattern and newline parameters is doublequotted. example with verbose logs

running

It can be started as a module:

python -m lsshipper --config_dir <dir with configs>

Why?

There is windows software that adds preallocated block of zeroes(\x00) to log file. Original filebeat skips such blocks. So big part of logs can be lost.

Speed

On my mac mini late 2003 it can write to network about 2Mb/s. I will test later on windows and linux. I believe on linux it should be much faster.

Problems

  1. On very fast server reconnects it can loose one log string. Please check test_connection.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lsshipper-0.1.8.tar.gz (8.0 kB view details)

Uploaded Source

File details

Details for the file lsshipper-0.1.8.tar.gz.

File metadata

  • Download URL: lsshipper-0.1.8.tar.gz
  • Upload date:
  • Size: 8.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for lsshipper-0.1.8.tar.gz
Algorithm Hash digest
SHA256 c0186598843624026b40026c57eb0420610194646e6b2b895f90002fb70f04a4
MD5 a5e942f2a8584c527d175e537bfb1f15
BLAKE2b-256 1d59ef5e6383e7777de98b8eda392b81fb7f3a1f9391103567374272709acd88

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page