1 code implementation • 22 Sep 2018 • Yang Tao, Wei Yadong, Tu Zhijun, Zeng Haolun, Kinsy Michel A., Zheng Nanning, Ren Pengju
In this paper, we explore efficient hardware implementations of activation functions using purely combinational circuits, with a focus on two widely used nonlinear activation functions, i. e., SELU and tanh.