Provides differentiable communication primitives such as Send/Recv/Gather etc for pytorch. Autograd can backpropagate through those, making distributed model parallel models easy to implement.
The author of this package has not provided a project description
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size||File type||Python version||Upload date||Hashes|
|Filename, size diffdist-0.1.tar.gz (4.6 kB)||File type Source||Python version None||Upload date||Hashes View|