Mitigating Shortcuts in Language Models with Soft Label Encoding

no code implementations • 17 Sep 2023 • Zirui He, Huiqi Deng, Haiyan Zhao, Ninghao Liu, Mengnan Du

Recent research has shown that large language models rely on spurious correlations in the data for natural language understanding (NLU) tasks.

Natural Language Understanding Out-of-Distribution Generalization