Search Results for author: Ali Zindari

Found 2 papers, 0 papers with code

The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication

no code implementations19 May 2024 Kumar Kshitij Patel, Margalit Glasgow, Ali Zindari, Lingxiao Wang, Sebastian U. Stich, Ziheng Cheng, Nirmit Joshi, Nathan Srebro

In this paper, we provide new lower bounds for local SGD under existing first-order data heterogeneity assumptions, showing that these assumptions are insufficient to prove the effectiveness of local update steps.

Distributed Optimization

Cannot find the paper you are looking for? You can Submit a new open access paper.