Query S3 Log Files
Project description
S3 Log Query
S3 Log Query is a Python library that takes one or more log files stored in S3, fetches and aggregates log messages from the files based on certain parameters, and returns the messages in order of occurrence. This library utilizes S3 Select and multithreading for performance.
Installation
Use the package manager pip to install S3 Log Query.
pip install s3-log-query
Usage
from s3_log_query import LogQuery
logs = LogQuery(log_paths={'server1': 'server1/server1.log', 'db server': 'db_server/db_server.log',
'server2': 'server2/server2.log', 'server3': 'server3/server3/log'},
s3_bucket='mikethoun-logs')
logs.query(start='02/28/2020 5:20:55', entries=100, keys=['server1', 'db server'], min_severity=logging.WARN)
Contributing
Pull requests are welcome.
License
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
s3-log-query-1.0.0.tar.gz
(8.6 kB
view hashes)
Built Distribution
Close
Hashes for s3_log_query-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 20217276d92001c970648b10bfad0efc526bb80ff07c6c7f3a8b4c56f3c0e6f9 |
|
MD5 | 86a709bb5764279825896e528ef21d0b |
|
BLAKE2b-256 | 134de02c647310b150e1cddd70395cb7e333773af1f33a56336cea1bc134d29f |