A CLI tool to analyze journalctl logs with specific parsers and LLM integration.
Project description
LogWatch Analyzer
LogWatch Analyzer is a command-line tool to analyze system logs from journalctl on Linux systems. It uses a YAML configuration file to define specific analysis tasks and can leverage a Large Language Model (LLM) via Ollama, Gemini, or other providers for in-depth analysis and report generation.
Features
- Configurable Analysis: Define which logs to analyze directly in the
config.yamlfile. - Specific Parsers: Includes optimized parsers for common events like failed SSH logins and kernel errors.
- LLM Integration: Utilizes a Large Language Model for generic analysis and generating human-readable reports.
- Flexible Output: Displays results in formatted tables in the terminal or generates reports in Markdown format.
- Simple CLI Interface: Easy to use with arguments to list tasks, run specific ones, and set time windows.
Installation
You can install LogWatch Analyzer from PyPI:
pip install logwatch-analyzer
Configuration
To use LogWatch Analyzer, you need a config.yaml file. The script looks for this file in the following locations, in order of priority:
~/.config/logwatch/config.yaml(Recommended for users)config.yamlin the current directory where you run the command.
Create the file in one of these locations. The recommended approach is to create a user-specific configuration:
mkdir -p ~/.config/logwatch
touch ~/.config/logwatch/config.yaml
Then, paste the following content into your config.yaml file and customize it to your needs.
# Configuration file for LogWatch
# Section for LLM provider configuration
# NOTE: The model names provided below are examples.
# Please replace them with the actual models you intend to use.
llm_providers:
ollama:
type: "ollama"
api_url: "http://localhost:11434/api/generate"
model: "llama3.2:latest" # Example model
timeout: 120 # Request timeout in seconds
gemma:
type: "gemini"
# The URL for Gemma-3-27b-it. Change it if you want to use another model.
api_url: "https://generativelanguage.googleapis.com/v1beta/models/gemma-3-27b-it:generateContent"
# The API key will be read from the environment variable specified here.
api_key_env: "GEMINI_API_KEY"
timeout: 60 # Request timeout in seconds
gemini:
type: "gemini"
# The URL for Gemini 1.5 Flash. Change it if you want to use another model.
api_url: "https://generativelanguage.googleapis.com/v1beta/models/gemini-1.5-flash:generateContent"
# The API key will be read from the environment variable specified here.
api_key_env: "GEMINI_API_KEY"
timeout: 60 # Request timeout in seconds
openrouter:
type: "openrouter"
api_url: "https://openrouter.ai/api/v1/"
# You can change the model here. Examples: "google/gemma-2-9b-it", "anthropic/claude-3-haiku"
model: "qwen/qwen-2.5-coder-32b-instruct:free" # Example model
#model: "deepseek/deepseek-chat-v3-0324:free"
#model: "openai/gpt-oss-20b:free"
api_key_env: "OPENROUTER_API_KEY"
timeout: 60 # Request timeout in seconds
# Choose which LLM provider to use from the ones defined above.
active_llm_provider: "ollama"
# Definition of log analysis tasks
logs:
- name: "SSH Failed Logins"
command: "journalctl -u sshd -p err -o json --no-pager --since '1 day ago'"
parser: "ssh_parser"
# Filters to ignore irrelevant logs (examples)
filters:
- "pam_unix(sshd:auth): authentication failure" # Often redundant if you only look at "Failed password"
- name: "Sudo Usage"
command: "journalctl /usr/bin/sudo -o json --no-pager --since '1 day ago'"
parser: "llm_parser"
filters:
- "pam_unix(sudo:session): session opened for user root"
- "pam_unix(sudo:session): session closed for user root"
- name: "Kernel Errors"
command: "journalctl -k -p err -o json --no-pager --since '1 day ago'"
parser: "kernel_parser"
filters: []
- name: "General System Analysis"
command: "journalctl -p err -o json --no-pager --since '1 hour ago'"
parser: "llm_parser"
filters: []
Usage
The tool is available as the logwatch command.
List all available tasks
To see a list of all tasks defined in your config.yaml:
logwatch --list
Run a specific task
To execute a single analysis task:
logwatch --task "SSH Failed Logins"
Run all tasks
To run all tasks in sequence:
logwatch
Generate a Report File
For tasks that use the llm_parser, you can save the generated report to a Markdown file:
logwatch --task "Sudo Usage" --output report_sudo.md
Override the Time Window
You can specify a different time range from the one in the configuration file on the fly:
logwatch --task "Kernel Errors" --since "2 hours ago"
License
This project is licensed under the MIT License. See the LICENSE file for details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file logwatch_analyzer-0.1.9.tar.gz.
File metadata
- Download URL: logwatch_analyzer-0.1.9.tar.gz
- Upload date:
- Size: 9.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2cda4cee6f44fec9a75edc6dac5b7d2b6b04ae3e8e3ad7cf02204c808a394649
|
|
| MD5 |
5fc13e63d81adf2b6d160dd34bc9480a
|
|
| BLAKE2b-256 |
04bffb0d0b8dc7fd63cbebacc39af155e88b3e589d1cecd64d5f114f8aaf5225
|
File details
Details for the file logwatch_analyzer-0.1.9-py3-none-any.whl.
File metadata
- Download URL: logwatch_analyzer-0.1.9-py3-none-any.whl
- Upload date:
- Size: 11.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
11a133563b2de1fc989e30f39b600363f1d74d7b8ce6e3ce73cdb8adf9d51e99
|
|
| MD5 |
cec882fb96f5083ebb979d159c3081db
|
|
| BLAKE2b-256 |
d105c436ab6988968d23daaaa868c47abc291a589826d6428e13900ffb04e3d6
|