Skip to main content

From txt to sqlite3 parser of logs

Project description

From txt to sqlite3 parser of logs

Installation

$ pip install ulars

Usage

Parsing

First of all place lars.yml (see Examples for more info) file in the directory with your .log file then run lars parse one of the following command:

$ lars parse --path PATH_TO_LOG_FILE
$ lars parse --name APP_NAME
$ lars parse --id APP_ID

In order to use --name or --id arguments you have to add applications to lars. To get more information about application management see Application management part.

Application management

Add

To add application to list, use:

$ lars apps add --name APP_NAME --path PATH_TO_LOG_FILE

List

To list all applications, use:

$ lars apps list

Remove

To remove application from list use

$ lars apps remove --id APP_ID

Examples

lars.yml

headers:
  - guid
  - log_date
  - log_level
  - logger_name
  - msg
primary_key: "guid"
table_name: "logs"
separator: " | "
encoding: "utf8"
db_filename: "logs.sqlite3"

.log

9951e948f4a64c859a8589ae111a1eea | 2019-12-05 21:10:06.2561727Z | Debug | Code.Engines.Player.PlayerInputToActionEngine | Found 0 entities with <PlayerInputEntityViewStruct, ActionEntityStruct>
c52029ca8e694c98845a417688c4f0c3 | 2019-12-05 21:10:06.4945353Z | Debug | Code.Engines.Common.MovementEngine | Found 0 entities with <ActionEntityStruct>
1e4c0ba2ebcb486499bfa06f592e3b3d | 2019-12-05 21:10:06.4945353Z | Debug | Code.Engines.Common.MovementEngine | Found 0 entities with <ActionEntityStruct>
e7515daf01484f5196e7bb1a0b6b3329 | 2019-12-05 21:10:06.4945353Z | Debug | Code.Engines.Common.MovementEngine | Found 0 entities with <ActionEntityStruct>

Development

This project includes a number of helpers in the Makefile to streamline common development tasks.

Environment Setup

The following demonstrates setting up and working with a development environment:

### create a virtualenv for development

$ make virtualenv

$ source env/bin/activate


### run lars cli application

$ lars --help


### run pytest / coverage

$ make test

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for ulars, version 1.0.9b0
Filename, size File type Python version Upload date Hashes
Filename, size ulars-1.0.9b0-py3-none-any.whl (12.8 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size ulars-1.0.9b0.tar.gz (9.6 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page