Reduce multiple TensorBoard runs to new event (or CSV) files
Project description
This project was inspired by
tensorboard-aggregator
(a similar project built with TensorFlow rather than PyTorch) and this SO answer.
Compute reduced statistics (mean
, std
, min
, max
, median
or any other numpy
operation) of multiple TensorBoard runs matching a directory glob pattern. This can be used after training multiple identical models to reduce the noise in their loss/accuracy/error curves e.g. when trying to establish a statistically significant improvement in training performance.
Requires PyTorch and TensorBoard. No TensorFlow installation required.
Installation
pip install tensorboard-reducer
Usage
Example:
tb-reducer -i 'glob_pattern/of_dirs_to_reduce*' -o basename_of_output_dir -r mean,std,min,max
tb-reducer
has the following flags:
-i/--indirs-glob
(required): Glob pattern of the run directories to reduce.-o/--outdir
(required): Name of the directory to save the new reduced run data. If--format
istb-events
, a separate directory will be created for each reduce op (mean
,std
, ...) post-fixed by the op's name (outdir-mean
,outdir-std
, ...). If--format
iscsv
, a single file will created andoutdir
must end with a.csv
extension.-r/--reduce-ops
(required): Comma-separated names of numpy reduction ops (mean
,std
,min
,max
, ...). Default ismean
. Each reduction is written to a separateoutdir
suffixed by its op name, e.g. ifoutdir='my-new-run
, the mean reduction will be written tomy-new-run-mean
.-f/--format
: Output format of reduced TensorBoard runs. One oftb-events
for regular TensorBoard event files orcsv
. Ifcsv
,-o/--outdir
must have.csv
extension and all reduction ops will be written to a single CSV file rather than separate directories for each reduce op. Usepandas.read_csv("path/to/file.csv", header=[0, 1], index_col=0)
to read data back into memory as a multi-index dataframe.-w/--overwrite
(optional): Whether to overwrite existingoutdir
s/CSV files.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for tensorboard-reducer-0.1.4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4c27d638b32ec52e1d4d4978e6d6f8a7b9a02f4155a210a1d1df0ef54633f149 |
|
MD5 | 447d91e02d329c2ef1b53439fe04db2f |
|
BLAKE2b-256 | 4854105ed59ab2ce4288e2937ae422b2c1472163d8843276d61baa2ed510011a |
Hashes for tensorboard_reducer-0.1.4-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ad98bc84dbdcca7d89733ecafde1f81579b6ac28d49d3c0c0cd3c9d74e3f4090 |
|
MD5 | 32a1c0cc36732d34e558c6462f83a779 |
|
BLAKE2b-256 | e94a6411371f739c97e472dbc8938e52323cc0efb3477afbc9bee61f591d100e |