no code implementations • 21 Dec 2023 • Ran Greidi, Kobi Cohen
FLARE presents a novel sparse training approach via accumulated pulling of the updated models with regularization on the embeddings in the FL process, providing a powerful solution to the staleness effect, and pushing sparsity to an exceptional level.