deepgpu 2.0.2rc0

('DEEPGPU is a distributed training accelerator including AGSpeed and ACSpeed', 'DEEPGPU-2.0 AGSpeed (DEEPGPU compute Graph Speeding) is a AI computing accelerator for Pytorch', 'DEEPGPU-2.0 ACSpeed (DEEPGPU communication Compiler Speeding) is a distributed training framework accelerator-plugin for PyTorch', 'and deepgpu nccl communication plugin for many deeplearning framwork including TensorFlow, PyTorch, MXNet and Caffe')

DEEPGPU-2.0 ACSpeed means DEEPGPU communication Compiler Speeding. This is a distributed training framework plugin for PyTorch and deepgpu nccl communication plugin for many deeplearning framworks including TensorFlow, PyTorch, MXNet and Caffe. This project is to create a uniform distributed training framework plugin tool for major frameworks, and make the distributed training as easy as possible and as fast as possible on Alibaba Cloud.