Skip to main content

A pre-commit script to make log lines lazier

Project description

Lazy log formatter

PyPI - Version PyPI - Python Version PyPI - Downloads License GitHub Actions Workflow Status pre-commit

A tool that automatically converts f-strings in Python logging calls into lazy logging calls for consistency with Python documentation, improved performance and linting compliance.

See PyPI page for more details. See Changelog for release notes.

Example:

# Before (f-string in log call; not recommended)
logger.info(f"On {datetime.now()} temperature in {city} is {temp:.2f}°C.")

# After lazy-log-formatter
logger.info("On %s temperature in %s is %.2f°C.", datetime.now(), city, temp)

# Prints: On 2024-06-01 12:00:00 temperature in Madrid is 21.50°C.

Why this tool?

In Python, the recommended way to log variable data is to use format-string placeholders and pass values separately:

import logging
logging.warning('%s before you %s', 'Look', 'leap!')

This approach:

References

Features

  • Scans Python files for f-strings used in logging calls.
  • Provides an option to automatically convert f-strings in logging calls to lazy logging calls.
  • Can be integrated as a pre-commit hook to enforce logging best practices in codebases.

Installation

Install from PyPI:

pip install lazy-log-formatter

Usage

You can either run the tool as a Python module, use it as a pre-commit hook, run the entry point script:

python -m lazy_log.cli [OPTIONS] [PATH...]

or

lazy-log-formatter [OPTIONS] [PATH...]

Pre-commit integration

Add the following to your .pre-commit-config.yaml:

- repo: https://github.com/dmar1n/lazy-log-formatter
  rev: 0.10.6
  hooks:
    - id: lazy-log-formatter
      args: ['--fix']

Command-line options

You can run the tool from the command line using the following options:

Option Description
--fix Converts f-strings in log calls to lazy logging syntax
--exclude [PATTERN...] Excludes files/directories matching one or more patterns
PATH [PATH...] One or more paths to scan (defaults to current directory)

Examples

Check all Python files in the current directory and subdirectories:

python -m lazy_log.cli .

Fix all Python files in the current directory and subdirectories:

python -m lazy_log.cli . --fix

Check all Python files in two directories:

python -m lazy_log.cli lazy_log/ tests/

Check specific files:

python -m lazy_log.cli lazy_log/cli.py tests/data/test.py

Exclude specific files or directories:

python -m lazy_log.cli tests/data --exclude "*.pyc" "__pycache__/*" 

Fix issues in all Python files in a directory:

python -m lazy_log.cli mydir --fix

Example transformations

Simple f-string

# Before
logger.info(f'Hello {name}')

# After
logger.info('Hello %s', name)

Multiple variables

# Before
logger.info(f'Hello {name} {surname}')

# After
logger.info('Hello %s %s', name, surname)

Class-based logging example

import logging
from datetime import datetime


def log_and_return_datetime():
    now = datetime.now()
    logging.info(f"Current datetime: {now}")
    return now


class DateTimeLogger:
    def __init__(self):
        self._logger = logging.getLogger(self.__class__.__name__)

    def log_datetime(self):
        now = datetime.now()
        self._logger.info(f"Current datetime: {now}")
        return now

After running the formatter without --fix, the output will be:

F-strings found in '...\tests\data\test.py':
 - F-string in logging call at ...\tests\data\test.py:8: f'Current datetime: {now}'
 - F-string in logging call at ...\tests\data\test.py:18: f'Current datetime: {now}'

After running the formatter with --fix, the output will be:

F-strings found and fixed in '...\tests\data\test.py'.

The transformed code will be:

import logging
from datetime import datetime


def log_and_return_datetime():
    now = datetime.now()
    logging.info("Current datetime: %s", now)
    return now


class DateTimeLogger:
    def __init__(self):
        self._logger = logging.getLogger(self.__class__.__name__)

    def log_datetime(self):
        now = datetime.now()
        self._logger.info("Current datetime: %s", now)
        return now

Notes

Code formatting with Black

When transforming code, the tool uses Black to reformat the modified files. If your project already uses Black, the changes produced by this tool will be consistent with Black’s formatting style.

Detection of log calls

The tool includes logic to detect logging calls based on the assumption that your logger instances follow common naming conventions (e.g., logger.info(...), log.info(...)). If a logger variable does not contain the substring "log" in its name, the tool will ignore it.

Other logging libraries

Only works with the native Python logging module. Other libraries, such as loguru, do not support lazy calls.

For loguru, see Lazy evaluation of expensive functions:

logger.opt(lazy=True).debug("If sink level <= DEBUG: {x}", x=lambda: expensive_function(2**64))

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lazy_log_formatter-0.10.6.tar.gz (9.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lazy_log_formatter-0.10.6-py3-none-any.whl (11.1 kB view details)

Uploaded Python 3

File details

Details for the file lazy_log_formatter-0.10.6.tar.gz.

File metadata

  • Download URL: lazy_log_formatter-0.10.6.tar.gz
  • Upload date:
  • Size: 9.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for lazy_log_formatter-0.10.6.tar.gz
Algorithm Hash digest
SHA256 0ec6158987646cfca11e93b67ead0058852a826a1e75b1574c3f00a3c6140b73
MD5 86ef706621dcdfab8ef914cb4cf93180
BLAKE2b-256 3ec716c78f11842f88c57f7f332ec0fd9fb8bf315720eefd42085e9617cefa5a

See more details on using hashes here.

Provenance

The following attestation bundles were made for lazy_log_formatter-0.10.6.tar.gz:

Publisher: release.yaml on dmar1n/lazy-log-formatter

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file lazy_log_formatter-0.10.6-py3-none-any.whl.

File metadata

File hashes

Hashes for lazy_log_formatter-0.10.6-py3-none-any.whl
Algorithm Hash digest
SHA256 3e415e83139b8493a4edacdcc944c981e946f0d930934f92c34593fea4740f21
MD5 1de9165510539e32ee9623437be9a464
BLAKE2b-256 c50f915e1554a23e9d39d7cda7a83c6a214a410373109840712be5b77e132e6e

See more details on using hashes here.

Provenance

The following attestation bundles were made for lazy_log_formatter-0.10.6-py3-none-any.whl:

Publisher: release.yaml on dmar1n/lazy-log-formatter

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page