no code implementations • 8 Oct 2021 • Dmitrii M. Ostrovskii, Babak Barazandeh, Meisam Razaviyayn
For $0 \le k \le 2$ the surrogate function can be efficiently maximized in $y$; our general approximation result then leads to efficient algorithms for finding a near-stationary point in nonconvex-nonconcave min-max problems, for which we also provide convergence guarantees.
no code implementations • 10 Jun 2021 • Babak Barazandeh, Tianjian Huang, George Michailidis
Min-max saddle point games have recently been intensely studied, due to their wide range of applications, including training Generative Adversarial Networks (GANs).
no code implementations • 12 May 2021 • Babak Barazandeh, Ali Ghafelebashi, Meisam Razaviyayn, Ram Sriharsha
When the additive noise in MLR model is Gaussian, Expectation-Maximization (EM) algorithm is a widely-used algorithm for maximum likelihood estimation of MLR parameters.
no code implementations • 26 Apr 2021 • Babak Barazandeh, Davoud Ataee Tarzanagh, George Michailidis
Adaptive momentum methods have recently attracted a lot of attention for training of deep neural networks.
no code implementations • 18 Mar 2020 • Babak Barazandeh, Meisam Razaviyayn
Min-max saddle point games appear in a wide range of applications in machine leaning and signal processing.
2 code implementations • 22 Apr 2019 • Babak Barazandeh, Meisam Razaviyayn, Maziar Sanjabi
This design helps us to avoid the min-max formulation and leads to an optimization problem that is stable and could be solved efficiently.
no code implementations • 22 Oct 2018 • Babak Barazandeh, Mohammadhussein Rafieisakhaei, Sunwook Kim, Zhenyu, Kong, Maury A. Nussbaum
Classification methods based on sparse estimation have drawn much attention recently, due to their effectiveness in processing high-dimensional data such as images.
no code implementations • 24 Sep 2018 • Babak Barazandeh, Meisam Razaviyayn
Our numerical experiments show that our algorithm outperforms the Naive EM algorithm in almost all scenarios.