Search Results for author: Kanishka Tyagi

Found 4 papers, 0 papers with code

Optimizing Performance of Feedforward and Convolutional Neural Networks through Dynamic Activation Functions

no code implementations10 Aug 2023 Chinmay Rane, Kanishka Tyagi, Michael Manry

Deep learning training training algorithms are a huge success in recent years in many fields including speech, text, image video etc.

Optimal Input Gain: All You Need to Supercharge a Feed-Forward Neural Network

no code implementations30 Mar 2023 Chinmay Rane, Kanishka Tyagi, Sanjeev Malalur, Yash Shinge, Michael Manry

Starting from equivalent networks, it is shown that pre-processing inputs using linear transformation are equivalent to multiplying the negative gradient matrix with an autocorrelation matrix per training iteration.

Cannot find the paper you are looking for? You can Submit a new open access paper.