no code implementations • SIGDIAL (ACL) 2020 • Thilo Michael, Sebastian Möller
We show how the turn-taking mechanisms modeled for conversations without delay perform in scenarios with delay and identify to which extend the simulation is able to model the delayed turn-taking observed in human conversation.
no code implementations • WMT (EMNLP) 2021 • Vivien Macketanz, Eleftherios Avramidis, Shushen Manakhimova, Sebastian Möller
We are using a semi-automated test suite in order to provide a fine-grained linguistic evaluation for state-of-the-art machine translation systems.
1 code implementation • HumEval (ACL) 2022 • Vivien Macketanz, Babak Naderi, Steven Schmidt, Sebastian Möller
The quality of machine-generated text is a complex construct consisting of various aspects and dimensions.
1 code implementation • EACL (HumEval) 2021 • Neslihan Iskender, Tim Polzehl, Sebastian Möller
Based on our empirical analysis, we provide guidelines to ensure the reliability of expert and non-expert evaluations, and we determine the factors that might affect the reliability of the human evaluation.
no code implementations • EMNLP (Eval4NLP) 2020 • Neslihan Iskender, Tim Polzehl, Sebastian Möller
On the one hand, the human assessment of summarization quality conducted by linguistic experts is slow, expensive, and still not a standardized procedure.
no code implementations • SIGDIAL (ACL) 2022 • Daniel Fernau, Stefan Hillmann, Nils Feldhus, Tim Polzehl, Sebastian Möller
Chatbots are increasingly used to automate operational processes in customer service.
1 code implementation • LREC 2022 • Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, He Wang, Renlong Ai, Shushen Manakhimova, Ursula Strohriegel, Sebastian Möller, Hans Uszkoreit
Furthermore, we present various exemplary applications of our test suite that have been implemented in the past years, like contributions to the Conference of Machine Translation, the usage of the test suite and MT outputs for quality estimation, and the expansion of the test suite to the language pair Portuguese–English.
no code implementations • LREC 2022 • Laura Seiffe, Fares Kallel, Sebastian Möller, Babak Naderi, Roland Roller
In order to provide suitable text for the target audience, it is necessary to measure its complexity.
no code implementations • ICON 2020 • Acharya Ashish Prabhakar, Salar Mohtaj, Sebastian Möller
Building an end to end fake news detection system consists of detecting claims in text and later verifying them for their authenticity.
1 code implementation • LREC 2022 • Lisa Raithel, Philippe Thomas, Roland Roller, Oliver Sapina, Sebastian Möller, Pierre Zweigenbaum
In this work, we present the first corpus for German Adverse Drug Reaction (ADR) detection in patient-generated content.
no code implementations • GermEval 2022 • Salar Mohtaj, Babak Naderi, Sebastian Möller
We designed the task as text regression in which participants developed models to predict complexity of pieces of text for a German learner in a range from 1 to 7.
1 code implementation • ACL 2022 • Galina Angelova, Eleftherios Avramidis, Sebastian Möller
We examine methods and techniques, proven to be helpful for the text-to-text translation of spoken languages in the context of gloss-to-text translation systems, where the glosses are the written representation of the signs.
no code implementations • EACL (HCINLP) 2021 • Neslihan Iskender, Tim Polzehl, Sebastian Möller
In recent years, crowdsourcing has gained much attention from researchers to generate data for the Natural Language Generation (NLG) tools or to evaluate them.
2 code implementations • 27 Mar 2024 • Lisa Raithel, Hui-Syuan Yeh, Shuntaro Yada, Cyril Grouin, Thomas Lavergne, Aurélie Névéol, Patrick Paroubek, Philippe Thomas, Tomohiro Nishiyama, Sebastian Möller, Eiji Aramaki, Yuji Matsumoto, Roland Roller, Pierre Zweigenbaum
User-generated data sources have gained significance in uncovering Adverse Drug Reactions (ADRs), with an increasing number of discussions occurring in the digital world.
no code implementations • 21 Feb 2024 • Navid Ashrafi, Vera Schmitt, Robert P. Spang, Sebastian Möller, Jan-Niklas Voigt-Antons
Preservation of private user data is of paramount importance for high Quality of Experience (QoE) and acceptability, particularly with services treating sensitive data, such as IT-based health services.
1 code implementation • 23 Jan 2024 • Qianli Wang, Tatiana Anikina, Nils Feldhus, Josef van Genabith, Leonhard Hennig, Sebastian Möller
Interpretability tools that offer explanations in the form of a dialogue have demonstrated their efficacy in enhancing users' understanding (Slack et al., 2023; Shen et al., 2023), as one-off explanations may fall short in providing sufficient information to the user.
1 code implementation • 9 Oct 2023 • Nils Feldhus, Qianli Wang, Tatiana Anikina, Sahil Chopra, Cennet Oguz, Sebastian Möller
While recently developed NLP explainability methods let us open the black box in various ways (Madsen et al., 2022), a missing ingredient in this endeavor is an interactive tool offering a conversational interface.
1 code implementation • 8 May 2023 • Leonhard Hennig, Philippe Thomas, Sebastian Möller
Relation extraction (RE) is a fundamental task in information extraction, whose extension to multilingual settings has been hindered by the lack of supervised resources comparable in size to large English datasets such as TACRED (Zhang et al., 2017).
1 code implementation • 13 Oct 2022 • Nils Feldhus, Leonhard Hennig, Maximilian Dustin Nasert, Christopher Ebert, Robert Schwarzenberg, Sebastian Möller
Saliency maps can explain a neural model's predictions by identifying important input features.
1 code implementation • 3 Aug 2022 • Lisa Raithel, Philippe Thomas, Roland Roller, Oliver Sapina, Sebastian Möller, Pierre Zweigenbaum
In this work, we present the first corpus for German Adverse Drug Reaction (ADR) detection in patient-generated content.
no code implementations • 13 Jul 2022 • Salar Mohtaj, Babak Naderi, Sebastian Möller, Faraz Maschhur, Chuyang Wu, Max Reinhard
Text readability assessment has a wide range of applications for different target people, from language learners to people with disabilities.
no code implementations • 8 Jul 2022 • Roland Roller, Laura Seiffe, Ammer Ayach, Sebastian Möller, Oliver Marten, Michael Mikhailov, Christoph Alt, Danilo Schmidt, Fabian Halleck, Marcel Naik, Wiebke Duettmann, Klemens Budde
However, in the context of clinical text processing the number of accessible datasets is scarce -- and so is the number of existing tools.
no code implementations • 13 Jun 2022 • Nils Feldhus, Ajay Madhavan Ravichandran, Sebastian Möller
The human-centric explainable artificial intelligence (HCXAI) community has raised the need for framing the explanation process as a conversation between human and machine.
no code implementations • 27 Apr 2022 • Roland Roller, Klemens Budde, Aljoscha Burchardt, Peter Dabrock, Sebastian Möller, Bilgin Osmanodja, Simon Ronicke, David Samhammer, Sven Schmeier
Scientific publications about machine learning in healthcare are often about implementing novel methods and boosting the performance - at least from a computer science perspective.
no code implementations • LREC 2022 • Anik Jacobsen, Salar Mohtaj, Sebastian Möller
Vocabulary learning is vital to foreign language learning.
no code implementations • 11 Jan 2022 • Salar Mohtaj, Vera Schmitt, Sebastian Möller
This paper presents TU Berlin team experiments and results on the task 1A and 1B of the shared task on hate speech and offensive content identification in Indo-European languages 2021.
2 code implementations • EMNLP (ACL) 2021 • Nils Feldhus, Robert Schwarzenberg, Sebastian Möller
To facilitate research, we present Thermostat which consists of a large collection of model explanations and accompanying analysis tools.
no code implementations • 13 May 2021 • Neslihan Iskender, Oleg Vasilyev, Tim Polzehl, John Bohannon, Sebastian Möller
Evaluating large summarization corpora using humans has proven to be expensive from both the organizational and the financial perspective.
1 code implementation • 3 May 2021 • Gabriel Mittags, Sebastian Möller
In this paper, we present a full-reference speech quality prediction model with a deep learning approach.
1 code implementation • 23 Apr 2021 • Gabriel Mittag, Sebastian Möller
Further, we show that the reliability of deep learning-based naturalness prediction can be improved by transfer learning from speech quality prediction models that are trained on objective POLQA scores.
2 code implementations • 20 Apr 2021 • Gabriel Mittag, Saman Zadtootaghaj, Thilo Michael, Babak Naderi, Sebastian Möller
The ground truth used for training image, video, or speech quality prediction models is based on the Mean Opinion Scores (MOS) obtained from subjective experiments.
1 code implementation • 19 Apr 2021 • Gabriel Mittag, Babak Naderi, Assmaa Chehadi, Sebastian Möller
In this paper, we present an update to the NISQA speech quality prediction model that is focused on distortions that occur in communication networks.
2 code implementations • EMNLP (BlackboxNLP) 2021 • Robert Schwarzenberg, Nils Feldhus, Sebastian Möller
Amid a discussion about Green AI in which we see explainability neglected, we explore the possibility to efficiently approximate computationally expensive explainers.
no code implementations • 5 Mar 2021 • Demóstenes Z. Rodríguez, Dick Carrillo Melgarejo, Miguel A. Ramírez, Pedro H. J. Nardelli, Sebastian Möller
However, the NB, WB, and FB E-model algorithms do not consider wireless techniques used in these networks, such as Multiple-Input-Multiple-Output (MIMO) systems, which are used to improve the communication system robustness in the presence of different types of wireless channel degradation.
no code implementations • WMT (EMNLP) 2020 • Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Aljoscha Burchardt, Sebastian Möller
This paper describes a test suite submission providing detailed statistics of linguistic performance for the state-of-the-art German-English systems of the Fifth Conference of Machine Translation (WMT20).
3 code implementations • 7 Jul 2020 • Karolina Zaczynska, Nils Feldhus, Robert Schwarzenberg, Aleksandra Gabryszak, Sebastian Möller
Most of the studies were conducted for the English language, however.
no code implementations • 23 May 2020 • Laura Seiffe, Oliver Marten, Michael Mikhailov, Sven Schmeier, Sebastian Möller, Roland Roller
This also applies to information about a person's health status.
no code implementations • 2 May 2020 • Markus Utke, Saman Zadtootaghaj, Steven Schmidt, Sebastian Möller
Video gaming streaming services are growing rapidly due to new services such as passive video streaming, e. g. Twitch. tv, and cloud gaming, e. g. Nvidia Geforce Now.
1 code implementation • 25 Mar 2020 • Babak Naderi, Tobias Hossfeld, Matthias Hirth, Florian Metzger, Sebastian Möller, Rafael Zequeira Jiménez
The subjective quality of transmitted speech is traditionally assessed in a controlled laboratory environment according to ITU-T Rec.
Multimedia
no code implementations • 16 Feb 2020 • Vinicius Woloszyn, Felipe Schaeffer, Beliza Boniatti, Eduardo Cortes, Salar Mohtaj, Sebastian Möller
In this paper, we demonstrate Untrue News, a new search engine for fake stories.
no code implementations • 16 Apr 2019 • Babak Naderi, Salar Mohtaj, Kaspar Ensikat, Sebastian Möller
This paper presents TextComplexityDE, a dataset consisting of 1000 sentences in German language taken from 23 Wikipedia articles in 3 different article-genres to be used for developing text-complexity predictor models and automatic text simplification in German language.
1 code implementation • NAACL 2019 • Robert Schwarzenberg, David Harbecke, Vivien Macketanz, Eleftherios Avramidis, Sebastian Möller
Evaluating translation models is a trade-off between effort and detail.