Log Generator 3000 - A modular log generation tool
Project description
๐ Log Generator 3000 (LG3K)
๐ The ultimate modular log generation tool, designed for modern systems! ๐
About
Welcome to Log Generator 3000โa fully modular log generation tool designed to simplify testing and monitoring across diverse systems. It supports web servers, APIs, databases, firewalls, and more.
This project was conceptualized, developed, and published entirely on an iPad during a Saturday evening of footballโand yes, the team we were rooting for won! ๐
Curious about the full story? Read more here.
Contributing
We believe in the power of community! LG3K becomes more valuable with each new contribution, whether it's adding new log types, improving existing ones, or enhancing the core functionality.
Ways to Contribute
-
Add New Log Types ๐
- Create new modules for different systems
- Enhance existing log formats
- Add more realistic log patterns
-
Improve Core Features ๐ ๏ธ
- Enhance performance
- Add new configuration options
- Improve error handling
-
Documentation ๐
- Improve documentation
- Add examples
- Write tutorials
-
Testing ๐งช
- Add unit tests
- Report bugs
- Suggest improvements
Getting Started with Contributing
- Fork the repository
- Create a feature branch (
git checkout -b feature-name) - Set up development environment:
python -m venv venv source venv/bin/activate # or `venv\Scripts\activate` on Windows pip install -r requirements-dev.txt # Installs all development dependencies pip install -e . # Install package in development mode pre-commit install
- Run tests:
pytest # Runs tests with coverage report
- Make your changes (the pre-commit hooks will ensure code quality)
- Write tests if applicable
- Update documentation if needed
- Commit your changes (
git commit -m 'Add feature') - Push to your branch (
git push origin feature-name) - Open a Pull Request
Development Guidelines
- Code is formatted with Black (88 characters line length)
- Imports are sorted with isort
- Code quality is checked with Flake8
- All functions and modules have docstrings
- Changes are covered by tests (when applicable)
๐ Project Structure
lg3k/
โโโ __init__.py # Package initialization
โโโ modules/ # Folder containing all log generation modules
โ โโโ web_server.py # Module for web server logs
โ โโโ database.py # Module for database logs
โ โโโ api.py # Module for API logs
โ โโโ firewall.py # Module for firewall logs
โ โโโ nas.py # Module for NAS logs
โ โโโ os.py # Module for OS logs
โ โโโ network.py # Module for network logs
โ โโโ printer.py # Module for printer logs
โ โโโ smarthome.py # Module for smart home devices and IoT
โโโ utils/ # Folder containing utility functions
โ โโโ config.py # Utilities for configuration handling
โ โโโ progress.py # Utilities for progress and threading
โ โโโ timestamp.py # Timestamp generation utilities
โจ Features
- Dynamic Module Loading: Easily add new log types by creating a module in the
modules/folder. - Scalable and Modular: Keep your codebase clean and maintainable by separating log logic into distinct files.
- Docker-Style Progress: Real-time progress tracking with Docker-like display for each module.
- Smart Home Support: Generate logs for IoT devices, ESP32/ESP8266, Zigbee/Z-Wave, and security cameras.
- High Volume: Generate up to 1,000,000 log entries per module.
- Rich UI: Beautiful, real-time progress bar for generating logs (or use
--simplemode for minimal output). - Fully Configurable: Modify the configuration file to control active services, total logs, threading, and more.
- Code Quality: Enforced by Black, isort, and Flake8 through pre-commit hooks.
- 100% Test Coverage: Comprehensive test suite ensuring reliability.
๐ Getting Started
Prerequisites
- Python 3.12 or later
- For users:
pip install -r requirements.txt
- For developers:
pip install -r requirements-dev.txt pip install -e . pre-commit install
Quick Start
-
Install the package:
pip install lg3k
-
Generate logs:
lg3k --count 1000 --threads 4
-
View help:
lg3k --help
Available Modules
-
Infrastructure
web_server- Web server access logsdatabase- Database operationsapi- API endpoint logsfirewall- Security eventsnas- Storage operationsos- System logsnetwork- Network trafficprinter- Print jobs
-
Smart Home & IoT
- Smart home devices (thermostats, lights, sensors)
- ESP32/ESP8266 microcontrollers
- Zigbee/Z-Wave devices
- Security cameras and doorbells
๐ Sample Output
Docker-Style Progress Display
1ff5d2e3: web_server [=========> ] 50.0%
5520ebfb: database [==========] Complete
e9c8c5d6: api [> ] Waiting
7a1b3c4d: smarthome [=======> ] 35.0%
...
Rich UI (Default Mode)
[Thread 1] โโโโโโโ 90% (90/100 logs)
[Thread 2] โโโโโโโโ 100% (100/100 logs) Completed: logs_part2.json
...
Simple Mode
Starting log generation for 1000 logs across 10 files.
Thread 1 completed generating ./logs/logs_part1.json
Thread 2 completed generating ./logs/logs_part2.json
...
๐ License
This project is licensed under the MIT License. See the LICENSE file for details.
๐ฌ Questions?
Feel free to open an issue or contact us at lg3k@dataloes.dk.
๐ Show Your Support
If you love Log Generator 3000, give us a โญ on GitHub! Spread the word and help others test their systems with ease.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file lg3k-0.6.3.tar.gz.
File metadata
- Download URL: lg3k-0.6.3.tar.gz
- Upload date:
- Size: 19.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.0.1 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1ee998ff8a34c17cabd923479844956e4d50966712257ab1faf353c65a692177
|
|
| MD5 |
5d6e793f4b8feaf7039b867048c51c46
|
|
| BLAKE2b-256 |
17a04315ca8fea78976d41e3430fb0be96a4de85a3f17e32912cbc6120f6a958
|
File details
Details for the file lg3k-0.6.3-py3-none-any.whl.
File metadata
- Download URL: lg3k-0.6.3-py3-none-any.whl
- Upload date:
- Size: 20.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.0.1 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
10571407da1dcf21fd8f93b1235193b2d71612a4ca7569e8cdeea31d07893155
|
|
| MD5 |
b0835d53d5c04f2a72cf61e983316d44
|
|
| BLAKE2b-256 |
74fdff256b6971c81ba1d78024fb10f6f6b9887a780b6557486f936e5d873e6d
|