Skip to main content

A pre-commit script to make log lines lazier

Project description

Lazy log formatter

PyPI - Version PyPI - Python Version PyPI - Downloads License GitHub Actions Workflow Status pre-commit

A tool that automatically converts f-strings in Python logging calls into lazy logging calls for consistency with Python documentation, improved performance and linting compliance.

See PyPI page for more details. See Changelog for release notes.

Example:

# Before (f-string in log call; not recommended)
logger.info(f"On {datetime.now()} temperature in {city} is {temp:.2f}°C.")

# After lazy-log-formatter
logger.info("On %s temperature in %s is %.2f°C.", datetime.now(), city, temp)

# Prints: On 2024-06-01 12:00:00 temperature in Madrid is 21.50°C.

Why this tool?

In Python, the recommended way to log variable data is to use format-string placeholders and pass values separately:

import logging
logging.warning('%s before you %s', 'Look', 'leap!')

This approach:

References

Features

  • Scans Python files for f-strings used in logging calls.
  • Provides an option to automatically convert f-strings in logging calls to lazy logging calls.
  • Can be integrated as a pre-commit hook to enforce logging best practices in codebases.

Installation

Install from PyPI:

pip install lazy-log-formatter

Usage

You can either run the tool as a Python module, use it as a pre-commit hook, run the entry point script:

lazy-log-formatter [OPTIONS] [PATH...]

or

python -m lazy_log.cli [OPTIONS] [PATH...]

Pre-commit integration

Add the following to your .pre-commit-config.yaml:

- repo: https://github.com/dmar1n/lazy-log-formatter
  rev: 0.12.0
  hooks:
    - id: lazy-log-formatter
      args: ['--fix']

Command-line options

You can run the tool from the command line using the following options:

Option Description
--fix Converts f-strings in log calls to lazy logging syntax
--exclude [PATTERN...] Excludes files/directories matching one or more patterns
PATH [PATH...] One or more paths to scan (defaults to current directory)

Examples

Check all Python files in the current directory and subdirectories:

lazy-log-formatter .

Fix all Python files in the current directory and subdirectories:

lazy-log-formatter . --fix

Check all Python files in two directories:

lazy-log-formatter lazy_log/ tests/

Check specific files:

lazy-log-formatter lazy_log/cli.py tests/data/test.py

Exclude specific files or directories:

lazy-log-formatter tests/data --exclude "*.pyc" "__pycache__/*" 

Fix issues in all Python files in a directory:

lazy-log-formatter mydir --fix

Example transformations

Simple f-string

# Before
logger.info(f'Hello {name}')

# After
logger.info('Hello %s', name)

Multiple variables

# Before
logger.info(f'Hello {name} {surname}')

# After
logger.info('Hello %s %s', name, surname)

Class-based logging example

import logging
from datetime import datetime

logger = logging.getLogger(__name__)


def log_and_return_datetime():
    now = datetime.now()
    logger.info(f"Current datetime: {now}")
    return now


class DateTimeLogger:
    def log_datetime(self):
        now = datetime.now()
        logger.info(f"Current datetime: {now}")
        return now

After running the formatter without --fix, the output will be:

F-strings found in '...\tests\data\test.py':
 - F-string in logging call at ...\tests\data\test.py:8: f'Current datetime: {now}'
 - F-string in logging call at ...\tests\data\test.py:18: f'Current datetime: {now}'

After running the formatter with --fix, the output will be:

F-strings found and fixed in '...\tests\data\test.py'.

The transformed code will be:

import logging
from datetime import datetime

logger = logging.getLogger(__name__)


def log_and_return_datetime():
    now = datetime.now()
    logger.info("Current datetime: %s", now)
    return now


class DateTimeLogger:
    def log_datetime(self):
        now = datetime.now()
        logger.info("Current datetime: %s", now)
        return now

Notes

Minimal, formatting-preserving changes

The tool rewrites code with LibCST. Only the logging calls being converted are modified; the rest of the file (quoting, spacing, blank lines and line endings) is left as it was. Generated format strings use double quotes.

Detection of log calls

The tool includes logic to detect logging calls based on the assumption that your logger instances follow common naming conventions (e.g., logger.info(...), log.info(...)). If a logger variable does not contain the substring "log" in its name, the tool will ignore it.

Other logging libraries

Only works with the native Python logging module. Other libraries, such as loguru, do not support lazy calls.

For loguru, see Lazy evaluation of expensive functions:

logger.opt(lazy=True).debug("If sink level <= DEBUG: {x}", x=lambda: expensive_function(2**64))

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lazy_log_formatter-0.12.0.tar.gz (10.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lazy_log_formatter-0.12.0-py3-none-any.whl (13.3 kB view details)

Uploaded Python 3

File details

Details for the file lazy_log_formatter-0.12.0.tar.gz.

File metadata

  • Download URL: lazy_log_formatter-0.12.0.tar.gz
  • Upload date:
  • Size: 10.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for lazy_log_formatter-0.12.0.tar.gz
Algorithm Hash digest
SHA256 29017e256c09fd239ebe76389996056c8938a3b4796a0f36b14393152751deff
MD5 f0e97bd5a2b7658c349fc481dc6d960f
BLAKE2b-256 ab6f0945762c82cf6196a2a12f59a873e1c359594b42b6245e7336db2fc017b2

See more details on using hashes here.

Provenance

The following attestation bundles were made for lazy_log_formatter-0.12.0.tar.gz:

Publisher: release.yaml on dmar1n/lazy-log-formatter

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file lazy_log_formatter-0.12.0-py3-none-any.whl.

File metadata

File hashes

Hashes for lazy_log_formatter-0.12.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3a2517a745e7b8d23d4aab08d514703c7e01f0b1f0c74ad2f26b5ecaa1f1c789
MD5 40093dbac5584090f7bccd86fe2cab1b
BLAKE2b-256 78a726474b8c0ecf650cb7cfd2943d3d2d6721410fd0fa4510ddbfdddc3feffa

See more details on using hashes here.

Provenance

The following attestation bundles were made for lazy_log_formatter-0.12.0-py3-none-any.whl:

Publisher: release.yaml on dmar1n/lazy-log-formatter

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page