Search Results for author:
Found 4 papers, 2 papers with code
From Human Judgements to Predictive Models: Unravelling Acceptability in Code-Mixed Sentences
To this end, we construct Cline - a dataset containing human acceptability judgements for English-Hindi (en-hi) code-mixed text.
COBIAS: Contextual Reliability in Bias Assessment
Our contribution is twofold: (i) we create a dataset of 2287 stereotyped statements augmented with points for adding context; (ii) we develop the Context-Oriented Bias Indicator and Assessment Score (COBIAS) to assess statements' contextual reliability in measuring bias.
SaGE: Evaluating Moral Consistency in Large Language Models
To this extent, we construct the Moral Consistency Corpus (MCC), containing 50K moral questions, responses to them by LLMs, and the RoTs that these models followed.
Measuring Moral Inconsistencies in Large Language Models
To address this issue, we propose a novel information-theoretic measure called Semantic Graph Entropy (SGE) to measure the consistency of an LLM in moral scenarios.
