dlcalc 0.1.3

No project description provided

dlcalc

random command line tools for deep learning

Installation

pip install dlcalc

or

git clone https://github.com/jfc4050/dlcalc
cd dlcalc
pip install -e .

Tools

3D Training Calculator

calculator for estimating various performance characteristics of 3D parallel transformer model training:

• memory consumption
• pipeline bubble
• communication overhead
• compute intensity
• etc..

3dtrn -h

we've include a sample config you can try tweaking

3dtrn examples/llama3_70b.yaml

Checkpoint Summarizer

gives a human-readable summarization of keys, values, and tensor shapes in a given training checkpoint.

ckpt-summarize -h

Development

install development dependencies

pip install -e .[dev]

static checks can be run with

bash checks