Annotation Sensitivity: Training Data Collection Methods Affect Model Performance

1 code implementation • 23 Nov 2023 • Christoph Kern, Stephanie Eckman, Jacob Beck, Rob Chew, Bolei Ma, Frauke Kreuter

We introduce the term annotation sensitivity to refer to the impact of annotation data collection methods on the annotations themselves and on downstream model performance and predictions.