1 code implementation • 23 Apr 2024 • Weiyan Shi, Ryan Li, Yutong Zhang, Caleb Ziems, Chunhua yu, Raya Horesh, Rogério Abreu de Paula, Diyi Yang
To enhance language models' cultural awareness, we design a generalizable pipeline to construct cultural knowledge bases from different online communities on a massive scale.
no code implementations • 5 Apr 2024 • Diyi Yang, Caleb Ziems, William Held, Omar Shaikh, Michael S. Bernstein, John Mitchell
People rely on social skills like conflict resolution to communicate effectively and to thrive in both work and personal life.
no code implementations • 28 Feb 2024 • Minzhi Li, Weiyan Shi, Caleb Ziems, Diyi Yang
As Natural Language Processing (NLP) systems become increasingly integrated into human social life, these technologies will need to increasingly rely on social intelligence.
no code implementations • 27 Oct 2023 • Julia Kruk, Caleb Ziems, Diyi Yang
We present Impressions, a novel dataset through which to investigate the semiotics of images, and how specific visual features and design choices can elicit specific emotions, thoughts and beliefs.
1 code implementation • 24 Oct 2023 • Minzhi Li, Taiwei Shi, Caleb Ziems, Min-Yen Kan, Nancy F. Chen, Zhengyuan Liu, Diyi Yang
Annotated data plays a critical role in Natural Language Processing (NLP) in training models and evaluating their performance.
1 code implementation • 4 Jun 2023 • Omar Shaikh, Caleb Ziems, William Held, Aryan J. Pariani, Fred Morstatter, Diyi Yang
Prior work uses simple reference games to test models of pragmatic reasoning, often with unidentified speakers and listeners.
1 code implementation • 26 May 2023 • Caleb Ziems, Jane Dwivedi-Yu, Yi-Chia Wang, Alon Halevy, Diyi Yang
We present NormBank, a knowledge bank of 155k situational norms.
1 code implementation • 26 May 2023 • Will Held, Caleb Ziems, Diyi Yang
Large Language Models, the dominant starting point for Natural Language Processing (NLP) applications, fail at a higher rate for speakers of English dialects other than Standard American English (SAE).
1 code implementation • 12 Apr 2023 • Caleb Ziems, William Held, Omar Shaikh, Jiaao Chen, Zhehao Zhang, Diyi Yang
We conclude that the performance of today's LLMs can augment the CSS research pipeline in two ways: (1) serving as zero-shot data annotators on human annotation teams, and (2) bootstrapping challenging creative generation tasks (e. g., explaining the underlying attributes of a text).
no code implementations • 15 Dec 2022 • Caleb Ziems, William Held, Jingfeng Yang, Jwala Dhamala, Rahul Gupta, Diyi Yang
First, we use this system to stress tests question answering, machine translation, and semantic parsing.
1 code implementation • ACL 2022 • Caleb Ziems, Minzhi Li, Anthony Zhang, Diyi Yang
Sentiment transfer is one popular example of a text style transfer task, where the goal is to reverse the sentiment polarity of a text.
1 code implementation • ACL 2022 • Caleb Ziems, Jiaao Chen, Camille Harris, Jessica Anderson, Diyi Yang
To understand disparities in current models and to facilitate more dialect-competent NLU systems, we introduce the VernAcular Language Understanding Evaluation (VALUE) benchmark, a challenging variant of GLUE that we created with a set of lexical and morphosyntactic transformation rules.
2 code implementations • ACL 2022 • Caleb Ziems, Jane A. Yu, Yi-Chia Wang, Alon Halevy, Diyi Yang
In this work, we introduce a new resource, not to authoritatively resolve moral ambiguities, but instead to facilitate systematic understanding of the intuitions, values and moral judgments reflected in the utterances of dialogue systems.
no code implementations • Findings (EMNLP) 2021 • Caleb Ziems, Diyi Yang
Framing has significant but subtle effects on public opinion and policy.
1 code implementation • EMNLP 2021 • Mai ElSherief, Caleb Ziems, David Muchlinski, Vaishnavi Anupindi, Jordyn Seybolt, Munmun De Choudhury, Diyi Yang
Hate speech has grown significantly on social media, causing serious consequences for victims of all demographics.
no code implementations • 15 Jun 2021 • Austin P Wright, Caleb Ziems, Haekyu Park, Jon Saad-Falcon, Duen Horng Chau, Diyi Yang, Maria Tomprou
As job markets worldwide have become more competitive and applicant selection criteria have become more opaque, and different (and sometimes contradictory) information and advice is available for job seekers wishing to progress in their careers, it has never been more difficult to determine which factors in a r\'esum\'e most effectively help career progression.
1 code implementation • 25 May 2020 • Bing He, Caleb Ziems, Sandeep Soni, Naren Ramakrishnan, Diyi Yang, Srijan Kumar
The spread of COVID-19 has sparked racism and hate on social media targeted towards Asian communities.
1 code implementation • 4 Apr 2020 • Caleb Ziems, Ymir Vigfusson, Fred Morstatter
Cyberbullying is a pervasive problem in online communities.
no code implementations • 2 Nov 2019 • Changmao Li, Han He, Yunze Hao, Caleb Ziems
This report assesses different machine learning approaches to 10-year survival prediction of breast cancer patients.