Horovod with Adasum for highly scalable distributed training.
Horovod is a distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. The goal of Horovod is to make distributed Deep Learning fast and easy to use. This version includes the highly scalable Adasum reduction algorithm.
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.