no code implementations • 24 Sep 2019 • Nouamane Laanait, Joshua Romero, Junqi Yin, M. Todd Young, Sean Treichler, Vitalii Starchenko, Albina Borisevich, Alex Sergeev, Michael Matheson
We introduce novel communication strategies in synchronous distributed Deep Learning consisting of decentralized gradient reduction orchestration and computational graph-aware grouping of gradient tensors.
no code implementations • NeurIPS Workshop Deep_Invers 2019 • Nouamane Laanait, Junqi Yin, Albina Borisevich
The phase problem in diffraction physics is one of the oldest inverse problems in all of science.