Skip to main content

A log parser for parsing logs generated from multi-processing based tools.

Project description

mplogp

build codecov Code Grade complexity vulnerabilities python

A Python script to parse a logfile generated from multi-processing based tools. The script will parse the logfile and create logs for each process under a specified timestamped folder. Supports log files generated from a log Formatter whose first two fields are: %(asctime)s %(processName)s ....

mplogp

usage: mplogp [-h] --log LOG --folder FOLDER [--regex REGEX]

A Python script to parse a logfile generated from multi-processing based tools

optional arguments:
  -h, --help       show this help message and exit
  --log LOG        The location of the logfile to parse
  --folder FOLDER  The folder where to write the parsed logs
  --regex REGEX    Regular expression to alias process log filename - must contain a matched group

Examples

Parse the example3.log file and write the parsed logs under the logs folder, add alias to each process log with its matched processor id:

mplogp --log example3.log --folder logs --regex ".*processor id (.*)$"

The log file contained logs from 10 processes and produced the following logs:

logs
└── 2021-05-13_18-48-46
    ├── MainProcess.log
    ├── Process-1-69b41899.log
    ├── Process-10-c40f3916.log
    ├── Process-2-a6ffc5b5.log
    ├── Process-3-14175157.log
    ├── Process-4-90e875c2.log
    ├── Process-5-ef35f44f.log
    ├── Process-6-c7268544.log
    ├── Process-7-7557d6d6.log
    ├── Process-8-e248e861.log
    └── Process-9-0bb23bab.log

Development

Build the Docker image:

docker image build \
-t \
mplogp:latest .

Run the Docker container:

docker container run \
--rm \
-it \
-v $PWD:/code \
mplogp:latest \
bash

Build the project:

pyb -X

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mplogp-0.1.1.tar.gz (4.1 kB view details)

Uploaded Source

Built Distribution

mplogp-0.1.1-py3-none-any.whl (4.3 kB view details)

Uploaded Python 3

File details

Details for the file mplogp-0.1.1.tar.gz.

File metadata

  • Download URL: mplogp-0.1.1.tar.gz
  • Upload date:
  • Size: 4.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.9.13

File hashes

Hashes for mplogp-0.1.1.tar.gz
Algorithm Hash digest
SHA256 e7e32e0846bc84bfcfb4b8c0b116896eb560d283c008b3b82620ea4837ad5e18
MD5 c19b57ea8380548776d0640cdec4544c
BLAKE2b-256 c98b9d39097c29867757f885fd120327b2bcc66c91b83b7c96ed0818e99bf0ca

See more details on using hashes here.

File details

Details for the file mplogp-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: mplogp-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 4.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.9.13

File hashes

Hashes for mplogp-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8382f238288875b59573a669fa4c5172b158d274d81d676f9638b43c178b841b
MD5 da940871c036a8a33d76f43a07be4bcc
BLAKE2b-256 13cd9806124d999667ce7a654837f94839be2dafb38b9664da091b3505e39822

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page