no code implementations • 4 Oct 2021 • Albert Lee, Kang L. Wang
Network design has been a central topic in machine learning.
1 code implementation • 23 Feb 2021 • Hao-Yuan Chang, Kang L. Wang
Deep neural networks can suffer from the exploding and vanishing activation problem, in which the networks fail to train properly because the neural signals either amplify or attenuate across the layers and become saturated.