Search Results for author: Sreeram Vennam

Found 2 papers, 1 papers with code

SaGE: Evaluating Moral Consistency in Large Language Models

1 code implementation21 Feb 2024 Vamshi Krishna Bonagiri, Sreeram Vennam, Priyanshul Govil, Ponnurangam Kumaraguru, Manas Gaur

To this extent, we construct the Moral Consistency Corpus (MCC), containing 50K moral questions, responses to them by LLMs, and the RoTs that these models followed.

Decision Making Moral Scenarios

Measuring Moral Inconsistencies in Large Language Models

no code implementations26 Jan 2024 Vamshi Krishna Bonagiri, Sreeram Vennam, Manas Gaur, Ponnurangam Kumaraguru

To address this issue, we propose a novel information-theoretic measure called Semantic Graph Entropy (SGE) to measure the consistency of an LLM in moral scenarios.

Decision Making Language Modelling +2

Cannot find the paper you are looking for? You can Submit a new open access paper.