An Empirical Study on the Robustness of Massively Multilingual Neural Machine Translation

1 code implementation • 13 May 2024 • Supryadi, Leiyu Pan, Deyi Xiong

Massively multilingual neural machine translation (MMNMT) has been proven to enhance the translation quality of low-resource languages.

Is Robustness Transferable across Languages in Multilingual Neural Machine Translation?

no code implementations • 31 Oct 2023 • Leiyu Pan, Supryadi, Deyi Xiong

In particular, we use character-, word-, and multi-level noises to attack the specific translation direction of the multilingual neural machine translation model and evaluate the robustness of other translation directions.

Data Augmentation Machine Translation +1

Evaluating Large Language Models: A Comprehensive Survey

1 code implementation • 30 Oct 2023 • Zishan Guo, Renren Jin, Chuang Liu, Yufei Huang, Dan Shi, Supryadi, Linhao Yu, Yan Liu, Jiaxuan Li, Bojian Xiong, Deyi Xiong

We hope that this comprehensive overview will stimulate further research interests in the evaluation of LLMs, with the ultimate goal of making evaluation serve as a cornerstone in guiding the responsible development of LLMs.