no code implementations • 5 Mar 2024 • Stefan Hackmann, Haniyeh Mahmoudian, Mark Steadman, Michael Schmidt
This approach, inspired by permutation importance for tabular data, masks each word in the system prompt and evaluates its effect on the outputs based on the available text scores aggregated over multiple user inputs.