django-log-formatter-ecs 0.0.2

ECS log formatter for Django

The library formats Django logs in ECS format.

https://www.elastic.co/guide/en/ecs/current/index.html

Mapping to the format is incomplete and best effort has been made to create logical field mappings between Django and ECS.

If you need to amend the mapping you can implement a custom formatter (see below).

Installation

pip install django-log-formatter-ecs

Usage

Using in a Django logging configuration:

from django_log_formatter_ecs import ECSFormatter

LOGGING = {
    ...
    "formatters": {
        "ecs_formatter": {
            "()": ECSFormatter,
        },
    },
    'handlers': {
        'ecs': {
            'formatter': 'ecs_formatter',
             ...
        },
    },
    "loggers": {
        "django": {
            "handlers": ["ecs"],
            ...
        },
    },
}

Dependencies

This package uses for kubi_ecs_logger https://github.com/kumina/kubi_ecs_logger for base ECS formatting

This package is compatible with django-user_agents https://pypi.org/project/django-user-agents/ which, when used, will enhance logged user agent information.

Settings

The formatter checks the setting LOG_SENSITIVE_USER_DATA to see if user information should be logged. If this is not set to true, only the user’s id is logged.

The Django configuration file logged is determined by running:

os.getenv('DJANGO_SETTINGS_MODULE')

You can set which formatter maps to which Django log by setting the ECS_FORMATTERS settings variable.

This defaults to:

ECS_FORMATTERS = {
    "root": ECSSystemFormatter,
    "django.request": ECSRequestFormatter,
    "django.db.backends": ECSSystemFormatter,
}

And can be used to wire up custom formatters (see next section).

Creating a custom formatter

If you wish to create your own ECS formatter, you can inherit from ECSSystemFormatter and call _get_event_base to get the base level logging data for use in augmentation:

class ECSSystemFormatter(ECSFormatterBase):
    def get_event(self):
        logger_event = self._get_event_base()

        # Customise logger event

        return logger_event

This can then be wired up to the list of ECS formatters used (see documentation of ECS_FORMATTERS for more information).

Tests

$ pip install -r requirements.txt
$ tox