Provides differentiable communication primitives such as Send/Recv/Gather etc for pytorch. Autograd can backpropagate through those, making distributed model parallel models easy to implement.
The author of this package has not provided a project description
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size & hash||File type||Python version||Upload date|
|diffdist-0.1.tar.gz (4.6 kB) View hashes||Source||None|