logs parsing subsystem library for airflow
Project description
LogsParser
Common log parser and analyzer
Project structure
How to dev
poetry shell
poetry install
├── debug.py
├── docs
│ ├── context diagram.drawio
│ └── uml.drawio
├── logs_parser
│ ├── analyzer - analyzer for logs
│ │ ├── analyzer.py
│ │ ├── data - data for IP2Location Lib
│ │ │ ├── IP2LOCATION-LITE-DB11.BIN
│ │ │ ├── LICENSE_LITE.TXT
│ │ │ └── README_LITE.TXT
│ │ └── plots.py - plots (deprecated)
│ ├── parser (multithread parser)
│ │ ├── filter.py - filter decorators
│ │ ├── logs_reader.py - logs reader
│ │ ├── log_structure.py - data classes
│ │ ├── logs_writer.py - logs writers
│ │ └── parser.py - parser
│ └── python_callables.py - callables for Airflow
├── notebooks - Jupyter notebooks,some experiment
│ ├── experiment.ipynb
│ └── gorod_09102021_231021.csv
├── poetry.lock
├── pyproject.toml
├── README.md
└── scripts - utils
├── split_logs.py
└── unite_logs.py
Arhitecture contex diagram
UML diagram
How to public to Pypi
First you need create api on pypi
poetry config pypi-token.pypi $(cat .token)
poetry publish --build
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
logsparsersubsystem-1.0.5.tar.gz
(21.6 MB
view hashes)
Built Distribution
Close
Hashes for logsparsersubsystem-1.0.5.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 38affca6c8a8138b14a3e88214e934338c1be1c45f0c584c265ac48f933ecce5 |
|
MD5 | 249e1ebf71df166c37a5b02b23255394 |
|
BLAKE2b-256 | 600484b63b4bc644179d4390e60b01d367846804862bb3f077c39092ef237c2e |
Close
Hashes for logsparsersubsystem-1.0.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 79458c53942cbbd4383566833a32fa5732bda76e3c3d78c7f38b90b10ad63792 |
|
MD5 | c399159f324abb991e200b014d04a179 |
|
BLAKE2b-256 | 68f5994cebf89b8dd458c62dbaa82ea8e64201f034da0971568a904f9f89ffde |