no code implementations • 16 Feb 2024 • Florian Le Bronnec, Alexandre Verine, Benjamin Negrevergne, Yann Chevaleyre, Alexandre Allauzen
We introduce a novel evaluation framework for Large Language Models (LLMs) such as \textsc{Llama-2} and \textsc{Mistral}, focusing on importing Precision and Recall metrics from image generation to text generation.
no code implementations • 1 Nov 2023 • Alexandre Verine, Muni Sreenivas Pydi, Benjamin Negrevergne, Yann Chevaleyre
Rejection sampling methods have recently been proposed to improve the performance of discriminator-based generative models.
Ranked #16 on Image Generation on CelebA 64x64
no code implementations • 1 Feb 2023 • Alexandre Verine, Benjamin Negrevergne, Muni Sreenivas Pydi, Yann Chevaleyre
Generative models can have distinct mode of failures like mode dropping and low quality samples, which cannot be captured by a single scalar metric.
no code implementations • ICML Workshop INNF 2021 • Alexandre Verine, Benjamin Negrevergne, Fabrice Rossi, Yann Chevaleyre
An invertible function is bi-Lipschitz if both the function and its inverse have bounded Lipschitz constants.