Skip to main content

Part of the yProv suite, and provides a unified interface for logging and tracking provenance information in machine learning experiments, both on distributed as well as large scale experiments.

Project description

HPCI Lab Logo

yProv4ML

A unified interface for logging and tracking provenance information in machine learning experiments, both on distributed as well as large scale experiments.
Explore the docs »

Report Bug · Request Feature


Contributors Forks Stars Issues GPLv3 License

This library is part of the yProv suite, and provides a unified interface for logging and tracking provenance information in machine learning experiments, both on distributed as well as large scale experiments.

It allows users to create provenance graphs from the logged information, and save all metrics and parameters to json format.

Data Model

Data Model

Example

Example

The image shown above has been generated from the example program provided in the example directory.

Metrics Visualization

Loss and GPU Usage

Emission Rate

Experiments and Runs

An experiment is a collection of runs. Each run is a single execution of a machine learning model. By changing the experiment_name parameter in the start_run function, the user can create a new experiment. All artifacts and metrics logged during the execution of the experiment will be saved in the directory specified by the experiment ID.

Several runs can be executed in the same experiment. All runs will be saved in the same directory (according to the specific experiment name and ID).

Documentation

For detailed information, please refer to the Documentation

Contributors

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

yprov4ml-3.2.2.tar.gz (68.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

yprov4ml-3.2.2-py3-none-any.whl (63.8 kB view details)

Uploaded Python 3

File details

Details for the file yprov4ml-3.2.2.tar.gz.

File metadata

  • Download URL: yprov4ml-3.2.2.tar.gz
  • Upload date:
  • Size: 68.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.11

File hashes

Hashes for yprov4ml-3.2.2.tar.gz
Algorithm Hash digest
SHA256 c349e324b94014b26bdd7e749f8154245fb9122e7d5e8e17c81d59b6c28e1c8a
MD5 b3d4e9b4c159a142af555d7cb5a806d1
BLAKE2b-256 f80e0cc0bb348303816d67b8ec00ee10971273e17d3ec0832ae9862b2d8dedf2

See more details on using hashes here.

File details

Details for the file yprov4ml-3.2.2-py3-none-any.whl.

File metadata

  • Download URL: yprov4ml-3.2.2-py3-none-any.whl
  • Upload date:
  • Size: 63.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.11

File hashes

Hashes for yprov4ml-3.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 f972c765c31ec23cb6b37a644ded5c472646301c9c536ef8d05811dd34f044d0
MD5 2095c67b87c4b4d2a08ff4ac8f2581ad
BLAKE2b-256 4f9d9739e2fdd4d9dc6a7c183e2457a1353d997ff34300cc52c3eecf96debd07

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page