no code implementations • 13 Oct 2022 • Diyuan Wu, Vyacheslav Kungurtsev, Marco Mondelli
In this paper, we focus on neural networks with two and three layers and provide a rigorous understanding of the properties of the solutions found by SHB: \emph{(i)} stability after dropping out part of the neurons, \emph{(ii)} connectivity along a low-loss path, and \emph{(iii)} convergence to the global optimum.
