Skip to main content

Tracking and Visualize after the burning PyTorch

Project description

Torch Ember

Tracking and visualize after the burning pytorch

This framework tracks the pytorch model:

  • On nn.Module level
  • Down to the metrics/ features of all tensors, includes
    • inputs/outputs of each module
    • weight/grad tensors
  • By minimal extra coding

WebUI

Other lovely features

  • Customizable metrics, with easy decorator syntax
  • Split the tracking log in the way you like, just mark(k=v,k1=v2...)
  • You can easily switch on/off the tracking:
    • Even cost of computation is tiny, torchember don't have to calculate metric for every iteration
    • Hence, you can track eg. only the last steps, only each 200 steps .etc

Installation

pip install torchember

Fast Tutorial

Step1, Track your model

Place you torch ember tracker on your model

from torchember.core import torchEmber
te = torchEmber(model)

The above can track input and output of every module,The following can track status of every module

for i in range(1000):
    ...
    loss.backward()
    optimizer.step()

    te.log_model()

Train your model as usual

Step2, Check the analysis on the WebUI

Run the service from terminal

$ torchember

The default port will be 8080

Or assign a port

$ torchember --port=4200

Visit your analysis at http://[host]:[port]

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

torchember-0.2.7.tar.gz (1.8 MB view details)

Uploaded Source

Built Distribution

torchember-0.2.7-py3-none-any.whl (1.9 MB view details)

Uploaded Python 3

File details

Details for the file torchember-0.2.7.tar.gz.

File metadata

  • Download URL: torchember-0.2.7.tar.gz
  • Upload date:
  • Size: 1.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.4

File hashes

Hashes for torchember-0.2.7.tar.gz
Algorithm Hash digest
SHA256 41bf4dc3b90deeb20a3d29d9373f303c4a7e679f50d8f04d9ad0d820c120435e
MD5 a5fe2a58a7e532aff569dabddf595e85
BLAKE2b-256 7df46433945cbbb30091bc0b37ade09e24138eaa0dd47c1937be8c4d4b71ec78

See more details on using hashes here.

File details

Details for the file torchember-0.2.7-py3-none-any.whl.

File metadata

  • Download URL: torchember-0.2.7-py3-none-any.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.4

File hashes

Hashes for torchember-0.2.7-py3-none-any.whl
Algorithm Hash digest
SHA256 f90c46d0d2697367e72858c83e206f85a109b44ad7614a2da4637ed8d7fed993
MD5 1c2c340b85b4a6120c690406d0e78a0e
BLAKE2b-256 832a2680adec8ceacdb68ab05639b045903baa7b191ab87b87944ec538268053

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page