no code implementations • 19 Nov 2016 • Steven Eliuk, Cameron Upright, Hars Vardhan, Stephen Walsh, Trevor Gale
The paper presents a parallel math library, dMath, that demonstrates leading scaling when using intranode, internode, and hybrid-parallelism for deep learning (DL).