The proliferation of machine learning has led to widespread use of artificial neural networks (ANNs) across diverse computing platforms, from cloud servers to edge devices. In the dominant paradigm, ...

Abstract: Distributed deep learning faces a major bottleneck in communication efficiency due to the frequent exchange of gradient information among computing nodes. Gradient compression offers a ...