Search Results for author: Nikolay Manchev

Found 1 papers, 1 papers with code

On the biological plausibility of orthogonal initialisation for solving gradient instability in deep neural networks

1 code implementation27 Oct 2022 Nikolay Manchev, Michael Spratling

Initialising the synaptic weights of artificial neural networks (ANNs) with orthogonal matrices is known to alleviate vanishing and exploding gradient problems.

Attribute

Cannot find the paper you are looking for? You can Submit a new open access paper.