Search Results for author:
Found 2 papers, 2 papers with code
Position Coupling: Leveraging Task Structure for Improved Length Generalization of Transformers
Even for simple arithmetic tasks like integer addition, it is challenging for Transformers to generalize to longer sequences than those encountered during training.
Tighter Lower Bounds for Shuffling SGD: Random Permutations and Beyond
We study convergence lower bounds of without-replacement stochastic gradient descent (SGD) for solving smooth (strongly-)convex finite-sum minimization problems.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
