ddpw 5.0.0

A utility package to scaffold PyTorch's DDP

DDPW

---

Distributed Data Parallel Wrapper (DDPW) is a lightweight wrapper that scaffolds PyTorch's (Distributed Data) Parallel.

This code is written in Python 3.10. The DDPW documentation contains details on how to use this package.

Overview

Installation

conda install -c tvsujal ddpw # with conda
pip install ddpw # with pip from PyPI

Usage

from ddpw import Platform, Wrapper

# some job
def run(global_rank, local_rank):
    print(f'This is node {global_rank}, device {local_rank}') 

# platform (e.g., 4 GPUs)
platform = Platform(device='gpu', n_gpus=4)

# wrapper
wrapper = Wrapper(platform=platform)

# start
wrapper.start(run)