Search Results for author:
Found 2 papers, 1 papers with code
The Unified Balance Theory of Second-Moment Exponential Scaling Optimizers in Visual Tasks
We have identified a potential method for unifying first-order optimizers through the use of variable Second-Moment Exponential Scaling(SMES).
Asymmetric Momentum: A Rethinking of Gradient Descent
It not only can accelerates slow-changing parameters for sparse gradients, similar to adaptive optimizers, but also can choose to accelerates frequently-changing parameters for non-sparse gradients, thus being adaptable to all types of datasets.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
