no code implementations • NAACL (DeeLIO) 2021 • Giovanni Puccetti, Alessio Miaschi, Felice Dell’Orletta
Several studies investigated the linguistic information implicitly encoded in Neural Language Models.
no code implementations • 22 Apr 2024 • Yuxia Wang, Jonibek Mansurov, Petar Ivanov, Jinyan Su, Artem Shelmanov, Akim Tsvigun, Osama Mohammed Afzal, Tarek Mahmoud, Giovanni Puccetti, Thomas Arnold, Chenxi Whitehouse, Alham Fikri Aji, Nizar Habash, Iryna Gurevych, Preslav Nakov
The task attracted a large number of participants: subtask A monolingual (126), subtask A multilingual (59), subtask B (70), and subtask C (30).
no code implementations • 27 Mar 2024 • Andrea Esuli, Giovanni Puccetti
This results in a lower number of available benchmarks to evaluate the performance of language models in Italian.
no code implementations • 17 Feb 2024 • Yuxia Wang, Jonibek Mansurov, Petar Ivanov, Jinyan Su, Artem Shelmanov, Akim Tsvigun, Osama Mohanned Afzal, Tarek Mahmoud, Giovanni Puccetti, Thomas Arnold, Alham Fikri Aji, Nizar Habash, Iryna Gurevych, Preslav Nakov
The advent of Large Language Models (LLMs) has brought an unprecedented surge in machine-generated text (MGT) across diverse channels.
1 code implementation • 23 May 2022 • Giovanni Puccetti, Anna Rogers, Aleksandr Drozd, Felice Dell'Orletta
While Transformer-based language models are generally very robust to pruning, there is the recently discovered outlier phenomenon: disabling only 48 out of 110M parameters in BERT-base drops its performance by nearly 30% on MNLI.