Parallel Logger
A Python logging utility designed for parallel processing applications. It provides an interactive curses-based terminal UI to monitor and debug logs from multiple threads in real-time.
Features
- Thread-aware logging: Automatically tracks and organizes logs by thread name
- Interactive TUI: Navigate between different threads using arrow keys
- Real-time updates: Logs are displayed as they're generated
- Easy integration: Simple API with context manager support
- Thread-safe: Built with thread safety in mind using locks and events
Installation
pip install parallel_logger
Quick Start
Using Context Manager (Recommended)
from concurrent.futures import ThreadPoolExecutor
from time import sleep
from parallel_logger import display_session, pl_print
def task(n):
pl_print(f"Task {n} starting")
sleep(n * 3)
pl_print(f"Task {n} completed")
return n * n
with display_session():
with ThreadPoolExecutor(max_workers=3) as executor:
for i in range(6):
executor.submit(task, i)
Manual Control
from parallel_logger import start_display, stop_display, pl_print
start_display()
try:
# Your parallel code here
pl_print("Hello from thread!")
finally:
stop_display()
API Reference
Core Functions
pl_print(*args, sep=" ", end="\n")
Records a message for the current thread. Works like Python's built-in print() function but routes output to the parallel logger instead of stdout.
Parameters:
*args: Values to printsep: Separator between values (default:" ")end: String appended after the last value (default:"\n")
display_session(refresh_rate=0.1)
Context manager that runs the curses viewer in a helper thread for the duration of the block.
Parameters:
refresh_rate: How often to refresh the display in seconds (default:0.1)
Example:
with display_session(refresh_rate=0.05):
# Your parallel code here
pass
start_display(refresh_rate=0.1)
Launches the curses UI on a helper thread and returns the thread object.
Parameters:
refresh_rate: How often to refresh the display in seconds (default:0.1)
Returns: threading.Thread object
stop_display()
Programmatically stops the display loop if it is running.
run_display(refresh_rate=0.1)
Runs the interactive viewer. This is a blocking call that will run until stopped.
Parameters:
refresh_rate: How often to refresh the display in seconds (default:0.1)
is_display_running()
Checks if the UI thread is currently alive.
Returns: bool - True if the display is running, False otherwise
Interactive UI Controls
When the display is running, you can interact with it using:
- Left Arrow (←): Switch to previous thread
- Right Arrow (→): Switch to next thread
- Q: Quit the display
The UI shows:
- Current thread name and position (e.g., "Thread 2/5: ThreadPoolExecutor-0_1")
- All logs from the selected thread
- Navigation instructions in the footer
Requirements
- Python >= 3.13
- Standard library only (no external dependencies)
Example
See the included example.py for a complete working demonstration:
python example.py --mode context
python example.py --mode manual
How It Works
The library uses a singleton ParallelLogger instance that:
- Collects log messages from each thread separately
- Maintains thread order based on first log appearance
- Renders logs in a curses-based terminal UI
- Allows interactive navigation between thread logs
All logging is thread-safe using threading.Lock() and coordination between threads is managed with threading.Event() objects.
License
See LICENSE file for details.
Author
Luca Mattiazzi
Metadata
Release files for parallel_logger 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| parallel_logger-0.1.0.tar.gz | 4.3 kB | Without provenance | Details for parallel_logger-0.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| parallel_logger-0.1.0-py3-none-any.whl | Python 3 | none | any | Details for parallel_logger-0.1.0-py3-none-any.whl |
Total release size: 9.6 kB
Release files / parallel_logger-0.1.0.tar.gz
| Download URL | parallel_logger-0.1.0.tar.gz |
|---|---|
| Size | 4.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
71048505da78d0d26212bbc5d104c3c6ff516e53068ae1e8b04f7ab35a8f64fe
|
|
BLAKE2b-256 checksum How to use checksums |
b4fbc8570f04d0d901ea1f4206c400fcf9d3d62f0e13b708168964a170317273
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.7.8
|
Release files / parallel_logger-0.1.0-py3-none-any.whl
| Download URL | parallel_logger-0.1.0-py3-none-any.whl |
|---|---|
| Size | 5.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
91da6bf8a43fe67dd1f429c76117a8481fb53da7536051627c0a50701813ea1b
|
|
BLAKE2b-256 checksum How to use checksums |
88c107861c607482bd1ae6cdd348377d0e3ea481b42cd75fa57ceb77922b6c10
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.7.8
|
Security for parallel_logger 0.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.