1 code implementation • 27 Oct 2022 • Nikolay Manchev, Michael Spratling
Initialising the synaptic weights of artificial neural networks (ANNs) with orthogonal matrices is known to alleviate vanishing and exploding gradient problems.
Attribute