Skip to main content

LoggingHandler to write directly into compressed archives and automatically limit disk usage

Project description

CompressedLogger

https://img.shields.io/pypi/v/compressedlogger.svg

This is a logging handler to be used with the standard python logging module. The handler compresses the *.log logfiles directly into a *.gz archive without writing an uncompressed file. You can choose the maximum size of a single *.gz file and the overall maximum size of all compressed logs. This allows you to limit the diskspace usage of your logs directly in the handler. You can also set a header string which will be written at the beginning of every new log file.

Behaviour:

  • Once the file size of the current log reaches the maximum size it gets rotated

  • Once the file sizes of all written logs together exceed the overall maximum size, the oldest logs will be deleted

  • If a header was given, it will be written at the beginning of every log file

  • The current logfile automatically rotates on date change

  • *.gz archives are named: foo.log-2020-07-15.1.gz, foo.log-2020-07-15.2.gz,…

The size limits are not completely strict. Each gzip file will be slightly larger than the maximum size since a gzip file needs to be flushed before closing it, which always adds some more bytes. E.g., when the limit is set to 1 MB, the actual filesize of a compressed log will be around 1.1 MB.

Usage:

There are five parameters:

  • log_path (str): path to the folder where the logs should be stored

  • filename (str): the base name of the logfile mylog

  • single_max_size (int): the maximum size of a single *.gz file in megabytes

  • overall_size (int): the maximum size of all *.gz files in megabytes

  • header (str): optional header that is written at the beginning of every logfile

compressed_handler = CompressedLogger(log_path="logs/",
                                      filename="foolog.log",
                                      header="----- version: 1.0.32 -----",
                                      single_max_size=1,
                                      overall_size=5)

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

0.2.8 (2020-07-28)

  • add missing support of logging formatters

  • fix the naming of logfiles if more than one handler writes into a log path

0.2.5 (2020-07-15)

  • updated project information and readme

0.2.0 (2020-07-15)

  • some improvements concerning the log paths and log file names

0.1.0 (2020-07-14)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

compressedlogger-0.2.8.tar.gz (9.3 kB view details)

Uploaded Source

Built Distribution

compressedlogger-0.2.8-py2.py3-none-any.whl (5.8 kB view details)

Uploaded Python 2Python 3

File details

Details for the file compressedlogger-0.2.8.tar.gz.

File metadata

  • Download URL: compressedlogger-0.2.8.tar.gz
  • Upload date:
  • Size: 9.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.2

File hashes

Hashes for compressedlogger-0.2.8.tar.gz
Algorithm Hash digest
SHA256 24a3f6de9aa856be992b46fba8ab13165af6c666430f39ff5cf24f9c79308e6e
MD5 86cf85971bca67becbece5f0b508b962
BLAKE2b-256 4e5eb72eba6df053046b41838e938374912582aed5211f2038ac915318cde75e

See more details on using hashes here.

File details

Details for the file compressedlogger-0.2.8-py2.py3-none-any.whl.

File metadata

  • Download URL: compressedlogger-0.2.8-py2.py3-none-any.whl
  • Upload date:
  • Size: 5.8 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.2

File hashes

Hashes for compressedlogger-0.2.8-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 da5155733d954a89367f26e0c6cb8d6b956bfc0e2bed172aa5fe1fa127b215ad
MD5 4a0e2ef30d96f71cd6233c359e815767
BLAKE2b-256 43d0dcc19293366f25fac84f77b8a5d2b8a9856ad23fbba793723b2c9700fe38

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page