Weak Correlations as the Underlying Principle for Linearization of Gradient-Based Learning Systems

no code implementations • 8 Jan 2024 • Ori Shem-Ur, Yaron Oz

As a case in point, we showcase this weak correlations structure within neural networks in the large width limit.