A log parser for parsing logs generated from multi-processing based tools.
Project description
mplogp
A Python script to parse a logfile generated from multi-processing based tools. The script will parse the logfile and create logs for each process under a specified timestamped folder. Supports log files generated from a log Formatter whose first two fields are: %(asctime)s %(processName)s ...
.
mplogp
usage: mplogp [-h] --log LOG --folder FOLDER [--regex REGEX]
A Python script to parse a logfile generated from multi-processing based tools
optional arguments:
-h, --help show this help message and exit
--log LOG The location of the logfile to parse
--folder FOLDER The folder where to write the parsed logs
--regex REGEX Regular expression to alias process log filename - must contain a matched group
Examples
Parse the example3.log
file and write the parsed logs under the logs
folder, add alias to each process log with its matched processor id:
mplogp --log example3.log --folder logs --regex ".*processor id (.*)$"
The log file contained logs from 10 processes and produced the following logs:
logs
└── 2021-05-13_18-48-46
├── MainProcess.log
├── Process-1-69b41899.log
├── Process-10-c40f3916.log
├── Process-2-a6ffc5b5.log
├── Process-3-14175157.log
├── Process-4-90e875c2.log
├── Process-5-ef35f44f.log
├── Process-6-c7268544.log
├── Process-7-7557d6d6.log
├── Process-8-e248e861.log
└── Process-9-0bb23bab.log
Development
Build the Docker image:
docker image build \
-t \
mplogp:latest .
Run the Docker container:
docker container run \
--rm \
-it \
-v $PWD:/code \
mplogp:latest \
bash
Build the project:
pyb -X
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file mplogp-0.1.1.tar.gz
.
File metadata
- Download URL: mplogp-0.1.1.tar.gz
- Upload date:
- Size: 4.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.9.13
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e7e32e0846bc84bfcfb4b8c0b116896eb560d283c008b3b82620ea4837ad5e18 |
|
MD5 | c19b57ea8380548776d0640cdec4544c |
|
BLAKE2b-256 | c98b9d39097c29867757f885fd120327b2bcc66c91b83b7c96ed0818e99bf0ca |
File details
Details for the file mplogp-0.1.1-py3-none-any.whl
.
File metadata
- Download URL: mplogp-0.1.1-py3-none-any.whl
- Upload date:
- Size: 4.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.9.13
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8382f238288875b59573a669fa4c5172b158d274d81d676f9638b43c178b841b |
|
MD5 | da940871c036a8a33d76f43a07be4bcc |
|
BLAKE2b-256 | 13cd9806124d999667ce7a654837f94839be2dafb38b9664da091b3505e39822 |