Skip to main content

A utility package to scaffold PyTorch's DDP

Project description

DDPW

Publish documentation to Surge Publish to Anaconda Publish to PyPI

The Distributed Data Parallel wrapper (DDPW) is created as a utility package to encapsulate the scaffolding for PyTorch's Distributed Data Parallel.

This code is written in Python 3.8. The DDPW documentation contains details on how to use this package.

Overview

Installation

conda install -c tvsujal ddpw # with conda
pip install ddpw # with pip from PyPI

Usage

from ddpw import DDPWrapper, Platform

job = DDPWrapper(platform=Platform.GPU, nprocs=4, ...) # train on 4 GPUs
job.start(epoch=30) # start training
job.resume(ckpt=20, epochs=60) # resume training from 20th epoch
e = job.evaluate(ckpt=50) # evaluate the model saved at 50th epoch

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ddpw-1.0.0.tar.gz (9.9 kB view details)

Uploaded Source

Built Distribution

ddpw-1.0.0-py3-none-any.whl (11.3 kB view details)

Uploaded Python 3

File details

Details for the file ddpw-1.0.0.tar.gz.

File metadata

  • Download URL: ddpw-1.0.0.tar.gz
  • Upload date:
  • Size: 9.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.12

File hashes

Hashes for ddpw-1.0.0.tar.gz
Algorithm Hash digest
SHA256 ea2e0b15826af4a15868ac5a614876fee5b291b756315fa19c6056467c198ccc
MD5 f3abb7fd485e6fbd169cba7fae23e75e
BLAKE2b-256 e88455d1e22522fd5afbc0640aad9ecf7bc871a372842a7a20df9f282bd30af5

See more details on using hashes here.

File details

Details for the file ddpw-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: ddpw-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 11.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.12

File hashes

Hashes for ddpw-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8c07b7a7780b064b5eabea409f40330e746c39ba26a2284bc29164a791399e0d
MD5 c829f00295c26d6dbe91401629946ae8
BLAKE2b-256 69a8a31199e81efa5334a5719af8040a36d1b9fd79f2ec0f7f5d28e1ee4b460a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page