structlog-gcp 0.2.4

A structlog set of processors to output as Google Cloud Logging format

Google Cloud Logging formatter for structlog

This is an opiniated package that configures structlog to output log compatible with the Google Cloud Logging log format.

The intention of this package is to be used for applications that run in Google Kubernetes Engine (GKE) or Google Cloud Function, or any other systems that know how to send logs to Google Cloud.

As such, the package is only concerned about formatting logs, where logs are expected to be written on the standard output. Sending the logs to the actual Google Logging API is supposed to be done by an external agent.

In particular, this package provides the following configuration by default:

• Logs are formatted as JSON using the Google Cloud Logging log format
• The Python standard library's logging log levels are available and translated to their GCP equivalents.
• Exceptions and CRITICAL log messages will be reported into Google Error Reporting dashboard
• Additional logger bound arguments will be reported into the jsonPayload event.

How to use?

Install the package with pip or your favorite Python package manager:

pip install structlog-gcp

Then, configure structlog as usual, using the Structlog processors the package provides:

import structlog
import structlog_gcp

processors = structlog_gcp.build_processors()
structlog.configure(processors=processors)

Then, you can use structlog as usual:

logger = structlog.get_logger().bind(arg1="something")

logger.info("Hello world")

converted = False
try:
    int("foobar")
    converted = True
except:
    logger.exception("Something bad happens")

if not converted:
    logger.critical("This is not supposed to happen", converted=converted)

Errors

Errors are automatically reported to the Google Error Reporting service.

You can configure the service name and the version used during the report with 2 different ways:

• By default, the library assumes to run with Cloud Function environment variables configured, in particular the K_SERVICE and K_REVISION variables.

• You can also pass the service name and revision at configuration time with:

  import structlog
  import structlog_gcp
  
  processors = structlog_gcp.build_processors(
      service="my-service",
      version="v1.2.3",
  )
  structlog.configure(processors=processors)
  

Examples

Check out the examples folder to see how it can be used.

• How it should appear in the Google Cloud Logging log explorer:

• How it should appear in the Google Cloud Error Reporting dashboard:

Reference

• https://cloud.google.com/logging/docs/structured-logging
• https://cloud.google.com/error-reporting/docs/formatting-error-messages
• https://cloud.google.com/logging/docs/reference/v2/rest/v2/LogEntry