Skip to main content

Load tensorboard event logs as pandas DataFrames; Read, parse, and plot tensorboard event logs with ease!

Project description

tbparse

pypi python PyPI - Downloads license

tests build doc codecov

Open In Colab

A simple yet powerful tensorboard event log parser/reader.

  • Supports parsing tensorboard event scalars, tensors, histograms, images, audio, hparams, and text.
  • Supports event generated by PyTorch, Tensorboard/Keras, and TensorboardX, with their respective usage examples documented in detail.
  • Allows parsing multiple tensorboard event files in a hierarchical directory structure.
  • Provides plotting examples for each type of events.
  • Stores the data in pandas.DataFrame to allow advanced filtering.
  • Both the documentation and code have high test coverage rate.
  • Follows PEP 484 with full type hints.

Installation:

pip install -U tbparse # requires Python >= 3.8

We suggest using an additional virtual environment for parsing and plotting the tensorboard events. So no worries if your training code uses Python 3.6 or older versions.

Reading one or more event files with tbparse only requires 5 lines of code:

from tbparse import SummaryReader
log_dir = "<PATH_TO_EVENT_FILE_OR_DIRECTORY>"
reader = SummaryReader(log_dir)
df = reader.scalars
print(df)

If you want an additional column with directory names (i.e., run names), change line 3 above to the following:

reader = SummaryReader(log_dir, extra_columns={'dir_name'})

For further information, start from the page: Parsing Scalars.

Gallery

Event Type Tensorboard Dashboard tbparse
Scalars
Tensors
Histograms
Images
Audio
HParams
Text

All events above are generated and plotted in gallery-pytorch.ipynb.

Installation

pip install tensorflow # optional, only required if you want to parse images and audio
pip install -U tbparse # requires Python >= 3.8

Note: For details on when TensorFlow is required, see Installing without TensorFlow.

Testing the Source Code

Test source code:

python3 -m pip install tox
python3 -m tox

Test and build documentation:

cd docs
make clean
# sphinx-tabs seems to require html be built before doctest
make html
make doctest

Generate test coverage:

python3 -m pip install pandas tensorflow torch tensorboardX pytest pytest-cov
python3 -m pytest --cov=./ --cov-report html

License

tbparse is distributed under the Apache License 2.0.

The tbparse PyPI package depends on (imports) the following third-party package. Each third-party software package is provided under its own license:

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tbparse-0.0.9.tar.gz (21.4 kB view details)

Uploaded Source

Built Distribution

tbparse-0.0.9-py3-none-any.whl (19.6 kB view details)

Uploaded Python 3

File details

Details for the file tbparse-0.0.9.tar.gz.

File metadata

  • Download URL: tbparse-0.0.9.tar.gz
  • Upload date:
  • Size: 21.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.19

File hashes

Hashes for tbparse-0.0.9.tar.gz
Algorithm Hash digest
SHA256 528e7da6929148b612a517adb5fbdee709224cb7e2420489a9b6b174f2f808bc
MD5 bcb5eed0fc80498807e5deabf2164703
BLAKE2b-256 970b553a13cb39f8ccad888c2d9b07e04cb1a60011e1073771fd6b5d904b61c4

See more details on using hashes here.

File details

Details for the file tbparse-0.0.9-py3-none-any.whl.

File metadata

  • Download URL: tbparse-0.0.9-py3-none-any.whl
  • Upload date:
  • Size: 19.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.19

File hashes

Hashes for tbparse-0.0.9-py3-none-any.whl
Algorithm Hash digest
SHA256 51a001728bc539a1efed9f03450b1e0151ad14011c8c52f156cf55dc1fbaa884
MD5 8799e0898521243a6dcfdbc0b2748968
BLAKE2b-256 177a56818acfbf03ef6eae4c3e0a7091ab6ffd8c3b44af93f2982297c07b50f2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page