no code implementations • 14 Feb 2024 • Maryam Amirizaniani, Jihan Yao, Adrian Lavergne, Elizabeth Snell Okada, Aman Chadha, Tanya Roosta, Chirag Shah
An effective method is to probe the LLM using different versions of the same question.
no code implementations • 14 Feb 2024 • Maryam Amirizaniani, Tanya Roosta, Aman Chadha, Chirag Shah
Probing LLMs with varied iterations of a single question could reveal potential inconsistencies in their knowledge or functionality.