Plugin for django to support Google Structured Logger
Project description
Django Google Structured Logger
Django Google Structured Logger is a Django middleware designed to capture and log details from incoming requests and outgoing responses. It offers features to mask sensitive data, set default fields for Google Cloud Logging, and structure logs in a detailed and organized manner.
Contents
Features:
- Detailed Logging: Logs both requests and responses with meticulous details.
- Sensitive Data Masking: Masks sensitive information using customizable regex patterns.
- Google Cloud Logging Support: Formats logs to match Google Cloud Logging standards.
- Configurable Settings: Customize log behavior through Django settings.
Usage:
-
Add
GoogleFormatter
to your Django'sLOGGING
setting. Example:LOGGING = { "version": 1, "disable_existing_loggers": False, "formatters": { "json": { "()": "django_google_structured_logger.formatter.GoogleFormatter", }, }, "handlers": { "google-json-handler": { "class": "logging.StreamHandler", "formatter": "json", }, }, "root": { "handlers": ["google-json-handler"], "level": logging.INFO, } }
-
Add
SetRequestToLoggerMiddleware
to your Django'sMIDDLEWARE
setting.Example for Django middleware:
MIDDLEWARE = [ ... # Ordering is important: "django_google_structured_logger.middlewares.SetUserContextMiddleware", # Set user context to logger. "django_google_structured_logger.middlewares.LogRequestAndResponseMiddleware", # Log request and response. ]
Example for GRAPHENE middleware:
GRAPHENE = { "MIDDLEWARE": [ ... # Ordering is important: "django_google_structured_logger.graphene_middlewares.GrapheneSetUserContextMiddleware", # Set user context to logger. "django_google_structured_logger.graphene_middlewares.GrapheneLogRequestAndResponseMiddleware", # Log request and response. ] }
-
Ensure your Django project has the necessary configurations in the
settings.py
.
Key Components:
1. middleware.py
- SetRequestToLoggerMiddleware: This class contains methods to process incoming requests and outgoing responses and then log them. It supports features like abridging lengthy data and masking sensitive information.
2. formatter.py
- GoogleFormatter: Extends
jsonlogger.JsonFormatter
to format logs specifically for Google Cloud Logging. It sets default fields such as severity, labels, operation, and source location based on Google's logging standards.
3. settings.py
- Provides a list of default sensitive keys for data masking.
- Allows customization of logging behavior with options to specify maximum string length, excluded endpoints, sensitive keys, and more.
Settings:
These are the settings that can be customized for the middleware:
LOG_MAX_STR_LEN
: Maximum string length before data is abridged. Default is200
.LOG_MAX_LIST_LEN
: Maximum list length before data is abridged. Default is10
.LOG_EXCLUDED_ENDPOINTS
: List of endpoints to exclude from logging. Default is anempty list
.LOG_SENSITIVE_KEYS
: Regex patterns for keys which contain sensitive data. DefaultsDEFAULT_SENSITIVE_KEYS
.LOG_MASK_STYLE
: Style for masking sensitive data. Default is"partially"
.LOG_MIDDLEWARE_ENABLED
: Enable or disable the logging middleware. Default isTrue
.LOG_EXCLUDED_HEADERS
: List of request headers to exclude from logging. DefaultsDEFAULT_SENSITIVE_HEADERS
.LOG_USER_ID_FIELD
: Field name for user ID. Default is"id"
.LOG_USER_DISPLAY_FIELD
: Field name for user email. Default is"email"
.LOG_MAX_DEPTH
: Maximum depth for data to be logged. Default is4
.
Note:
- All settings are imported from
django_google_structured_logger.settings
.
Other Notes:
extra
kwargs passed to logger, for example:logger.info("some message", extra={"some_key": "some_data}
will be logged as structured data in thejsonPayload
field in Google Cloud Logging. Any data passed to extra kwargs will not be abridged or masked.extra
kwargs passed to logger may override any default fields set byGoogleFormatter
.
Conclusion:
SetRequestToLoggerMiddleware is a comprehensive solution for those seeking enhanced logging capabilities in their Django projects, with particular attention to sensitive data protection and compatibility with Google Cloud Logging.
To get started, integrate the provided middleware, formatter, and settings into your Django project, customize as needed, and enjoy advanced logging capabilities!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for django-google-structured-logger-0.2.4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1aaaf5bd90c65646c5ba9938657b6a90cebfd63c94e348e1fa2a26b1d5a39725 |
|
MD5 | 86bb2db945f7ba74a6739e9199a4dc85 |
|
BLAKE2b-256 | aa8cabf04fec0a9c0a69690df4f2dfc9a73a837a5085874e3bea5cc765e851e5 |
Hashes for django_google_structured_logger-0.2.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e967d23e30bc17c738d0a42bce3cd1b15442f1051043bb076b8e467124de3929 |
|
MD5 | 3258b79c3cbe5db3bb4cb8d9e01d35ed |
|
BLAKE2b-256 | cbded6f7b37415cad5e9fa5533f1a0bde0c3689aca7bc7def3a0904b8883ed9e |