no code implementations • 24 May 2023 • Zhen-Ru Zhang, Chuanqi Tan, Haiyang Xu, Chengyu Wang, Jun Huang, Songfang Huang
In addition, taking the gate as a probing, we validate the efficiency and effectiveness of the variable prefix.
no code implementations • 17 Apr 2023 • Zhen-Ru Zhang, Chuanqi Tan, Songfang Huang, Fei Huang
Recent studies have demonstrated the potential of cross-lingual transferability by training a unified Transformer encoder for multiple languages.