Search Results for author:
Found 6 papers, 3 papers with code
Language Patterns and Behaviour of the Peer Supporters in Multilingual Healthcare Conversational Forums
In this work, we conduct a quantitative linguistic analysis of the language usage patterns of multilingual peer supporters in two health-focused WhatsApp groups in Kenya comprising of youth living with HIV.
Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
The deployment of Large Language Models (LLMs) in real-world applications presents both opportunities and challenges, particularly in multilingual and code-mixed communication settings.
AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages
Despite the recent progress on scaling multilingual machine translation (MT) to several under-resourced African languages, accurately measuring this progress remains challenging, since evaluation is often performed on n-gram matching metrics such as BLEU, which typically show a weaker correlation with human judgments.
MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks
We also perform a study on data contamination and find that several models are likely to be contaminated with multilingual evaluation benchmarks, necessitating approaches to detect and handle contamination while assessing the multilingual performance of LLMs.
MEGA: Multilingual Evaluation of Generative AI
Most studies on generative LLMs have been restricted to English and it is unclear how capable these models are at understanding and generating text in other languages.
A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation
We focus on two questions: 1) How can pre-trained models be used for languages not included in the initial pre-training?
