V. Rybalkin, N. Wehn, M. Yousefi, и D. Stricker. Proceedings of the Conference on Design, Automation & Test in Europe, стр. 1394--1399. European Design and Automation Association, (2017)
Y. Lin, S. Han, H. Mao, Y. Wang, и W. Dally. (2017)cite arxiv:1712.01887Comment: we find 99.9% of the gradient exchange in distributed SGD is redundant; we reduce the communication bandwidth by two orders of magnitude without losing accuracy.