google-cloud-mldiagnostics 0.4.0

diagnostic packages for profiling and ML experiment management

google-cloud-mldiagnostics

Overview

TBD

Supported Framework

• jax-ml
  • any versions
• Other in progress

How to install

Install

Install pypi package link

pip install google-cloud-mldiagnostics

This package does not install jax-ml and xprof and expected they will be installed separately.

Imports

Add important into training script

from google_cloud_mldiagnostics import machinelearning_run
from google_cloud_mldiagnostics import metrics
from google_cloud_mldiagnostics import xprof

How to use

Monitor training

At the begging of training script add next one:

from google_cloud_mldiagnostics import machinelearning_run

machinelearning_run(
  gcs_path="gs://<bucket>",
)

Monitor with ondemand profiling

from google_cloud_mldiagnostics import machinelearning_run

machinelearning_run(
  gcs_path="gs://<bucket>",
  on_demand_xprof=True
)

Monitor with profiling

from google_cloud_mldiagnostics import machinelearning_run
from google_cloud_mldiagnostics import xprof

machinelearning_run(
  gcs_path="gs://<bucket>",
)

xprof=xprof()
xprof.start()
# some code
xprof.stop()

Monitor with customer metrics

from google_cloud_mldiagnostics import machinelearning_run
from google_cloud_mldiagnostics import metrics

machinelearning_run(
  gcs_path="gs://<bucket>",
)

metrics.record("<my-metric>", <value>)

To pair metric value with current step:

metrics.record("<my-metric>", <value>, step=1)