no code implementations • 17 May 2023 • Shigeng Sun, Yuchen Xie
In this paper, we propose a novel algorithm for adaptive step length selection in the classical SGD framework, which can be readily adapted to other stochastic algorithms.