1 code implementation • 4 Dec 2023 • Eleftheria Briakou, Navita Goyal, Marine Carpuat
Explainable NLP techniques primarily explain by answering "Which tokens in the input are responsible for this prediction?''.
1 code implementation • 16 Nov 2023 • Jiayi Wang, David Ifeoluwa Adelani, Sweta Agrawal, Marek Masiak, Ricardo Rei, Eleftheria Briakou, Marine Carpuat, Xuanli He, Sofia Bourhim, Andiswa Bukula, Muhidin Mohamed, Temitayo Olatoye, Tosin Adewumi, Hamam Mokayed, Christine Mwase, Wangui Kimotho, Foutse Yuehgoh, Anuoluwapo Aremu, Jessica Ojo, Shamsuddeen Hassan Muhammad, Salomey Osei, Abdul-Hakeem Omotayo, Chiamaka Chukwuneke, Perez Ogayo, Oumaima Hourrane, Salma El Anigri, Lolwethu Ndolela, Thabiso Mangwana, Shafie Abdi Mohamed, Ayinde Hassan, Oluwabusayo Olufunke Awoyomi, Lama Alkhaled, sana al-azzawi, Naome A. Etori, Millicent Ochieng, Clemencia Siro, Samuel Njoroge, Eric Muchiri, Wangari Kimotho, Lyse Naomi Wamba Momo, Daud Abolade, Simbiat Ajao, Iyanuoluwa Shode, Ricky Macharm, Ruqayya Nasir Iro, Saheed S. Abdullahi, Stephen E. Moore, Bernard Opoku, Zainab Akinjobi, Abeeb Afolabi, Nnaemeka Obiefuna, Onyekachi Raphael Ogbu, Sam Brian, Verrah Akinyi Otiende, Chinedu Emmanuel Mbonu, Sakayo Toadoum Sari, Yao Lu, Pontus Stenetorp
Despite the recent progress on scaling multilingual machine translation (MT) to several under-resourced African languages, accurately measuring this progress remains challenging, since evaluation is often performed on n-gram matching metrics such as BLEU, which typically show a weaker correlation with human judgments.
no code implementations • 23 May 2023 • Navita Goyal, Eleftheria Briakou, Amanda Liu, Connor Baumler, Claire Bonial, Jeffrey Micher, Clare R. Voss, Marine Carpuat, Hal Daumé III
In this work, we study how users interact with QA systems in the absence of sufficient information to assess their predictions.
no code implementations • 17 May 2023 • Eleftheria Briakou, Colin Cherry, George Foster
We investigate the role of incidental bilingualism -- the unintentional consumption of bilingual signals, including translation examples -- in explaining the translation capabilities of large language models, taking the Pathways Language Model (PaLM) as a case study.
1 code implementation • 18 Jan 2023 • Weijia Xu, Sweta Agrawal, Eleftheria Briakou, Marianna J. Martindale, Marine Carpuat
Neural sequence generation models are known to "hallucinate", by producing outputs that are unrelated to the source text.
no code implementations • ACL 2022 • Eleftheria Briakou, Marine Carpuat
Synthetic translations have been used for a wide range of NLP tasks primarily as a means of data augmentation.
no code implementations • Findings (NAACL) 2022 • Eleftheria Briakou, Sida I. Wang, Luke Zettlemoyer, Marjan Ghazvininejad
Mined bitexts can contain imperfect translations that yield unreliable training signals for Neural Machine Translation (NMT).
2 code implementations • EMNLP 2021 • Eleftheria Briakou, Sweta Agrawal, Joel Tetreault, Marine Carpuat
While the field of style transfer (ST) has been growing rapidly, it has been hampered by a lack of standardized practices for automatic evaluation.
1 code implementation • ACL (GEM) 2021 • Eleftheria Briakou, Sweta Agrawal, Ke Zhang, Joel Tetreault, Marine Carpuat
However, in style transfer papers, we find that protocols for human evaluations are often underspecified and not standardized, which hampers the reproducibility of research in this field and progress toward better human and automatic evaluation methods.
no code implementations • NAACL 2021 • Eleftheria Briakou, Di Lu, Ke Zhang, Joel Tetreault
We take the first step towards multilingual style transfer by creating and releasing XFORMAL, a benchmark of multiple formal reformulations of informal text in Brazilian Portuguese, French, and Italian.
2 code implementations • ACL 2021 • Eleftheria Briakou, Marine Carpuat
While it has been shown that Neural Machine Translation (NMT) is highly sensitive to noisy parallel training samples, prior work treats all types of mismatches between source and target as noise.
1 code implementation • 8 Apr 2021 • Eleftheria Briakou, Di Lu, Ke Zhang, Joel Tetreault
We take the first step towards multilingual style transfer by creating and releasing XFORMAL, a benchmark of multiple formal reformulations of informal text in Brazilian Portuguese, French, and Italian.
1 code implementation • EMNLP 2020 • Eleftheria Briakou, Marine Carpuat
Detecting fine-grained differences in content conveyed in different languages matters for cross-lingual NLP and multilingual corpora analysis, but it is a challenging machine learning problem since annotation is expensive and hard to scale.
no code implementations • WS 2019 • Eleftheria Briakou, Marine Carpuat
This paper describes the University of Maryland{'}s submission to the WMT 2019 Kazakh-English news translation task.
no code implementations • NAACL 2019 • Eleftheria Briakou, Nikos Athanasiou, Alexandros Potamianos
In traditional Distributional Semantic Models (DSMs) the multiple senses of a polysemous word are conflated into a single vector space representation.