no code implementations • 6 Oct 2023 • Zeyu Yun, Juexiao Zhang, Bruno Olshausen, Yann Lecun, Yubei Chen
Unsupervised representation learning has seen tremendous progress but is constrained by its reliance on data modality-specific stationarity and topology, a limitation not found in biological intelligence systems.
no code implementations • 30 Sep 2022 • Yubei Chen, Zeyu Yun, Yi Ma, Bruno Olshausen, Yann Lecun
Though there remains a small performance gap between our simple constructive model and SOTA methods, the evidence points to this as a promising direction for achieving a principled and white-box approach to unsupervised learning.
Ranked #1 on Unsupervised MNIST on MNIST
Self-Supervised Learning Sparse Representation-based Classification +3
1 code implementation • NAACL (DeeLIO) 2021 • Zeyu Yun, Yubei Chen, Bruno A Olshausen, Yann Lecun
Transformer networks have revolutionized NLP representation learning since they were introduced.