Skip to main content

Export summary metrics and config from runs as a csv file from a project

Project description

wandbtocsv

Background

wandbtocsv allows you to quickly export a flat csv file of the top level metrics, config, etc. from your Weights & Biases runs in an easy to use CLI interface. This utility will also get peak gpu and system memory usage for each run.

Install

pip install wandbtocsv

How to use

!wandbtocsv -h
usage: wandbtocsv [-h] [--entity ENTITY] [--project PROJECT]
                  [--output_file OUTPUT_FILE]

options:
  -h, --help                 show this help message and exit
  --entity ENTITY            Entity for the WANDB runs. If not provided,
                             attempts to fetch from environment variable
                             'WANDB_ENTITY'.
  --project PROJECT          Project for the WANDB runs. If not provided,
                             attempts to fetch from environment variable
                             'WANDB_PROJECT'.
  --output_file OUTPUT_FILE  Path to save the output CSV. Default name format:
                             {entity}-{project}-{mmddyy}.csv
!wandbtocsv --entity hamelsmu --project deepspeed-data
Fetching runs... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00% 0:00:01[36m0:00:03
Saved 480 runs to hamelsmu-deepspeed-data-100823.csv

Bonus, explore your wandb runs in Datasette

csvs-to-sqlite hamelsmu-deepspeed-data-100823.csv hamelsmu-deepspeed-data-100823.db
datasette hamelsmu-deepspeed-data-100823.db -o

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wandbtocsv-0.0.6.tar.gz (8.8 kB view details)

Uploaded Source

Built Distribution

wandbtocsv-0.0.6-py3-none-any.whl (8.4 kB view details)

Uploaded Python 3

File details

Details for the file wandbtocsv-0.0.6.tar.gz.

File metadata

  • Download URL: wandbtocsv-0.0.6.tar.gz
  • Upload date:
  • Size: 8.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.12

File hashes

Hashes for wandbtocsv-0.0.6.tar.gz
Algorithm Hash digest
SHA256 e7d1f3615c1b3acf1c1580bb8b52eb898fa91c2580ca9b1ace67fc4608eeff27
MD5 6d5e11e51f91aa022bb820b85a5652b1
BLAKE2b-256 5a7a0572af776c82895e819e1f843bcfe24f21f64996cf77fb1fbee8a1c4117b

See more details on using hashes here.

File details

Details for the file wandbtocsv-0.0.6-py3-none-any.whl.

File metadata

  • Download URL: wandbtocsv-0.0.6-py3-none-any.whl
  • Upload date:
  • Size: 8.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.12

File hashes

Hashes for wandbtocsv-0.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 40672b9ff27b86c22d493f3311d08f25bc2895c83411d2acfe5a0a6c72634ca3
MD5 2b089d66d1d8d2bfc13ee2ff7a7b0abe
BLAKE2b-256 26eb023887afe4b721be0cd9c9847795be356d9aca6639f182f23c3bf167e9c8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page