Skip to main content

Export summary metrics and config from runs as a csv file from a project

Project description

wandbtocsv

Background

wandbtocsv allows you to quickly export a flat csv file of the top level metrics, config, etc. from your Weights & Biases runs in an easy to use CLI interface. This utility will also get peak gpu and system memory usage for each run.

Install

pip install wandbtocsv

How to use

!wandbtocsv -h
usage: wandbtocsv [-h] [--entity ENTITY] [--project PROJECT]
                  [--output_file OUTPUT_FILE]

options:
  -h, --help                 show this help message and exit
  --entity ENTITY            Entity for the WANDB runs. If not provided,
                             attempts to fetch from environment variable
                             'WANDB_ENTITY'.
  --project PROJECT          Project for the WANDB runs. If not provided,
                             attempts to fetch from environment variable
                             'WANDB_PROJECT'.
  --output_file OUTPUT_FILE  Path to save the output CSV. Default name format:
                             {entity}-{project}-{mmddyy}.csv
!wandbtocsv --entity hamelsmu --project deepspeed-data
Fetching runs... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00% 0:00:01[36m0:00:03
Saved 480 runs to hamelsmu-deepspeed-data-100823.csv

Bonus, explore your wandb runs in Datasette

csvs-to-sqlite hamelsmu-deepspeed-data-100823.csv hamelsmu-deepspeed-data-100823.db
datasette hamelsmu-deepspeed-data-100823.db -o

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wandbtocsv-0.0.6.tar.gz (8.8 kB view hashes)

Uploaded Source

Built Distribution

wandbtocsv-0.0.6-py3-none-any.whl (8.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page