Distributed torch training using horovod and slurm
Project description
dmlcloud
Flexibel, easy-to-use, opinionated
dmlcloud is a library for distributed training of deep learning models with torch. Unlike other similar frameworks, dmcloud adds as little additional complexity and abstraction as possible. It is tailored towards a carefully selected set of libraries and workflows.
Installation
pip install dmlcloud
Why dmlcloud?
- Easy initialization of
torch.distributed(supports slurm and MPI). - Simple, yet powerful, API. No unnecessary abstractions and complications.
- Checkpointing and metric tracking (distributed)
- Extensive logging and diagnostics out-of-the-box. Greatly improve reproducability and traceability.
- A wealth of useful utility functions required for distributed training (e.g. for data set sharding)
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
dmlcloud-0.3.3-py3-none-any.whl
(22.2 kB
view hashes)
