Search Results for author:
Found 2 papers, 0 papers with code
On the Weight Dynamics of Deep Normalized Networks
Recent studies have shown that high disparities in effective learning rates (ELRs) across layers in deep neural networks can negatively affect trainability.
Nonlinear Advantage: Trained Networks Might Not Be As Complex as You Think
We perform an empirical study of the behaviour of deep networks when fully linearizing some of its feature channels through a sparsity prior on the overall number of nonlinear units in the network.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
