Analyze log files on remote hosts locally
Project description
Remote Log Analysis
Overview
A log file is a sequence of bytes where some immutability guarantee exists for already written data. New data can be appended to the end of a log file but bytes which have already been written should not change while accessed via this framework. Such logs can be large and efficiently processing such logs in chunks can save on data transfer costs and time. Note that any static file can be considered a log file.
The above definition is very general and opens the door to just about any file-like object which can be accessed over the network. By this definition a network stream itself can be considered a log file and a goal of this framework is to provide the groundwork to make such extensions possible. In general, The more structured the data, the more useful this framework is for skipping efficiently within the log file but this framework can be useful for accessing just about any stream-like object over a network.
Examples will be developed over time to showcase the possibilities.
Tests
To run the tests do the following from the project root directory:
poetry install
pytest -s tests/
To run the tests with coverage try this from the project root directory:
pytest -s --cov=remote_log_analysis --cov-report=html tests/
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for remote_log_analysis-0.1.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1436caaef0dde492c327d73d16916f1948d398767603fdc7c882950f1470826d |
|
MD5 | ffd5846ddcf1cff8f2b0bc220a7ec3ad |
|
BLAKE2b-256 | cfbb12fb8c3f42ee4ab6c6656b82fd7e12cefc28e35080db087cc99b676c6f99 |
Hashes for remote_log_analysis-0.1.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8fe98de090465cbe29af2b600a9e3d353fbbf045331cb033003b6c19e477a86f |
|
MD5 | 7a3dfb6bfa92ab74a171264bbdff1c05 |
|
BLAKE2b-256 | b0d0a85c9f0c549909066d079aa71dd7f3cf6a36367f1c298131afa2ec3a73cf |