Search Results for author: Fred Philippy

Found 4 papers, 3 papers with code

Forget NLI, Use a Dictionary: Zero-Shot Topic Classification for Low-Resource Languages with Application to Luxembourgish

2 code implementations5 Apr 2024 Fred Philippy, Shohreh Haddadan, Siwen Guo

A common method for ZSC is to fine-tune a language model on a Natural Language Inference (NLI) dataset and then use it to infer the entailment between the input document and the target labels.

Language Modelling Natural Language Inference +2

Soft Prompt Tuning for Cross-Lingual Transfer: When Less is More

1 code implementation6 Feb 2024 Fred Philippy, Siwen Guo, Shohreh Haddadan, Cedric Lothritz, Jacques Klein, Tegawendé F. Bissyandé

Soft Prompt Tuning (SPT) is a parameter-efficient method for adapting pre-trained language models (PLMs) to specific tasks by inserting learnable embeddings, or soft prompts, at the input layer of the PLM, without modifying its parameters.

Cross-Lingual Transfer

Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Review

no code implementations26 May 2023 Fred Philippy, Siwen Guo, Shohreh Haddadan

To enhance the structure of this review and to facilitate consolidation with future studies, we identify five categories of such factors.

Zero-Shot Cross-Lingual Transfer

Cannot find the paper you are looking for? You can Submit a new open access paper.