THRONE: An Object-based Hallucination Benchmark for the Free-form Generations of Large Vision-Language Models

no code implementations • 8 May 2024 • Prannay Kaul, Zhizhong Li, Hao Yang, Yonatan Dukler, Ashwin Swaminathan, C. J. Taylor, Stefano Soatto

By evaluating a large selection of recent LVLMs using public datasets, we show that an improvement in existing metrics do not lead to a reduction in Type I hallucinations, and that established benchmarks for measuring Type I hallucinations are incomplete.

Attribute Data Augmentation +2