no code implementations • 25 Apr 2024 • Kabir Ahuja, Vidhisha Balachandran, Madhur Panwar, Tianxing He, Noah A. Smith, Navin Goyal, Yulia Tsvetkov
Transformers trained on natural language data have been shown to learn its hierarchical structure and generalize to sentences with unseen syntactic structures without explicitly encoding any structural bias.
1 code implementation • 8 Jun 2023 • Madhur Panwar, Kabir Ahuja, Navin Goyal
One of the main discoveries in this line of research has been that for several function classes, such as linear regression, transformers successfully generalize to new functions in the class.
no code implementations • ACL 2021 • Madhur Panwar, Shashank Shailabh, Milan Aggarwal, Balaji Krishnamurthy
Topic models have been widely used to learn text representations and gain insight into document corpora.