1 code implementation • COLING 2022 • Hsiu-Yu Yang, Carina Silberer
We seek to determine the capability of pretrained visual-linguistic models as knowledge sources on demand.
1 code implementation • 18 Dec 2023 • Hsiu-Yu Yang, Carina Silberer
Affordance knowledge is a fundamental aspect of commonsense knowledge.
no code implementations • WASSA (ACL) 2022 • Anna Khlyzova, Carina Silberer, Roman Klinger
The emotions of anger and sadness are best predicted with a multimodal model, while text alone is sufficient for disgust, joy, and surprise.
2 code implementations • 8 Jun 2021 • Ioannis Kazakos, Carles Ventura, Miriam Bellver, Carina Silberer, Xavier Giro-i-Nieto
Recent advances in deep learning have brought significant progress in visual grounding tasks such as language-guided video object segmentation.
1 code implementation • COLING 2020 • Carina Silberer, Sina Zarrie{\ss}, Matthijs Westera, Gemma Boleda
We also find that standard evaluations underestimate the actual effectiveness of the naming model: on the single-label names of the original dataset (Visual Genome), it obtains −27{\%} accuracy points than on MN v2, that includes all valid object names.
2 code implementations • 1 Oct 2020 • Miriam Bellver, Carles Ventura, Carina Silberer, Ioannis Kazakos, Jordi Torres, Xavier Giro-i-Nieto
The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which the phrase refers.
Ranked #1 on Referring Expression Segmentation on A2Dre test
no code implementations • LREC 2020 • Carina Silberer, Sina Zarrie{\ss}, Gemma Boleda
We highlight the challenges involved and provide a preliminary analysis of the ManyNames data, showing that there is a high level of agreement in naming, on average.
no code implementations • 5 Nov 2019 • Alba Herrera-Palacio, Carles Ventura, Carina Silberer, Ionut-Teodor Sorodoc, Gemma Boleda, Xavier Giro-i-Nieto
The goal of this work is to segment the objects in an image that are referred to by a sequence of linguistic descriptions (referring expressions).
1 code implementation • NAACL 2019 • Laura Aina, Carina Silberer, Matthijs Westera, Ionut-Teodor Sorodoc, Gemma Boleda
In this paper we analyze the behavior of two recently proposed entity-centric models in a referential task, Entity Linking in Multi-party Dialogue (SemEval 2018 Task 4).
no code implementations • EMNLP 2018 • Carina Silberer, Manfred Pinkal
We address the task of visual semantic role labeling (vSRL), the identification of the participants of a situation or event in a visual scene, and their labeling with their semantic relations to the event or situation.
1 code implementation • SEMEVAL 2018 • Laura Aina, Carina Silberer, Ionut-Teodor Sorodoc, Matthijs Westera, Gemma Boleda
This paper describes our winning contribution to SemEval 2018 Task 4: Character Identification on Multiparty Dialogues.