Human Judgment Classification
2 papers with code • 1 benchmarks • 0 datasets
A task where an algorithm judges which sample is better in accordance with human judgment.
Most implemented papers
CLIPScore: A Reference-free Evaluation Metric for Image Captioning
Image captioning has conventionally relied on reference-based automatic evaluations, where machine captions are compared against captions written by humans.
Mutual Information Divergence: A Unified Metric for Multimodal Generative Models
Based on a recent trend that multimodal generative evaluations exploit a vison-and-language pre-trained model, we propose the negative Gaussian cross-mutual information using the CLIP features as a unified metric, coined by Mutual Information Divergence (MID).