Parametric Leaky Tanh: A New Hybrid Activation Function for Deep Learning

1 code implementation • 11 Aug 2023 • Stamatis Mastromichalakis

Activation functions (AFs) are crucial components of deep neural networks (DNNs), having a significant impact on their performance.

ALReLU: A different approach on Leaky ReLU activation function to improve Neural Networks Performance

1 code implementation • 11 Dec 2020 • Stamatis Mastromichalakis

Despite the unresolved 'dying ReLU problem', the classical ReLU activation function (AF) has been extensively applied in Deep Neural Networks (DNN), in particular Convolutional Neural Networks (CNN), for image classification.

Classification General Classification +1