1 code implementation • 10 May 2024 • Ilia Kuznetsov, Osama Mohammed Afzal, Koen Dercksen, Nils Dycke, Alexander Goldberg, Tom Hope, Dirk Hovy, Jonathan K. Kummerfeld, Anne Lauscher, Kevin Leyton-Brown, Sheng Lu, Mausam, Margot Mieskes, Aurélie Névéol, Danish Pruthi, Lizhen Qu, Roy Schwartz, Noah A. Smith, Thamar Solorio, Jingyan Wang, Xiaodan Zhu, Anna Rogers, Nihar B. Shah, Iryna Gurevych
We hope that our work will help set the agenda for research in machine-assisted scientific quality control in the age of AI, within the NLP community and beyond.
no code implementations • 31 Jan 2024 • Jan Buchmann, Max Eichler, Jan-Micha Bodensohn, Ilia Kuznetsov, Iryna Gurevych
Long documents often exhibit structure with hierarchically organized elements of different functions, such as section headers and paragraphs.
1 code implementation • 24 Feb 2023 • Dennis Zyska, Nils Dycke, Jan Buchmann, Ilia Kuznetsov, Iryna Gurevych
Recent years have seen impressive progress in AI-assisted writing, yet the developments in AI-assisted reading are lacking.
1 code implementation • 19 Dec 2022 • Martin Funkquist, Ilia Kuznetsov, Yufang Hou, Iryna Gurevych
To address this challenge, we propose CiteBench: a benchmark for citation text generation that unifies multiple diverse datasets and enables standardized evaluation of citation text generation models across task designs and domains.
1 code implementation • 12 Nov 2022 • Nils Dycke, Ilia Kuznetsov, Iryna Gurevych
Peer review constitutes a core component of scholarly publishing; yet it demands substantial expertise and training, and is susceptible to errors and biases.
no code implementations • 10 Nov 2022 • Ilia Kuznetsov, Iryna Gurevych
Natural language processing (NLP) researchers develop models of grammar, meaning and communication based on written text.
1 code implementation • 22 Apr 2022 • Ilia Kuznetsov, Jan Buchmann, Max Eichler, Iryna Gurevych
While existing NLP studies focus on the analysis of individual texts, editorial assistance often requires modeling interactions between pairs of texts -- yet general frameworks and datasets to support this scenario are missing.
1 code implementation • 27 Jan 2022 • Nils Dycke, Ilia Kuznetsov, Iryna Gurevych
The shift towards publicly available text sources has enabled language processing at unprecedented scale, yet leaves under-serviced the domains where public and openly licensed data is scarce.
no code implementations • 2 Sep 2021 • Nils Dycke, Edwin Simpson, Ilia Kuznetsov, Iryna Gurevych
Peer review is the primary means of quality control in academia; as an outcome of a peer review process, program and area chairs make acceptance decisions for each paper based on the review reports and scores they received.
no code implementations • EMNLP 2020 • Ilia Kuznetsov, Iryna Gurevych
Deep pre-trained contextualized encoders like BERT (Delvin et al., 2019) demonstrate remarkable performance on a range of downstream tasks.
1 code implementation • NAACL 2019 • Yang Gao, Steffen Eger, Ilia Kuznetsov, Iryna Gurevych, Yusuke Miyao
We then focus on the role of the rebuttal phase, and propose a novel task to predict after-rebuttal (i. e., final) scores from initial reviews and author responses.
3 code implementations • CL 2020 • Gözde Gül Şahin, Clara Vania, Ilia Kuznetsov, Iryna Gurevych
We present a reusable methodology for creation and evaluation of such tests in a multilingual setting.
no code implementations • CONLL 2018 • Ilia Kuznetsov, Iryna Gurevych
Thematic role hierarchy is a widely used linguistic tool to describe interactions between semantic roles and their syntactic realizations.
1 code implementation • COLING 2018 • Ilia Kuznetsov, Iryna Gurevych
We examine the effect of lemmatization and POS typing on word embedding performance in a novel resource-based evaluation scenario, as well as on standard similarity benchmarks.
1 code implementation • SEMEVAL 2017 • Steffen Eger, Erik-Lân Do Dinh, Ilia Kuznetsov, Masoud Kiaeeha, Iryna Gurevych
From these approaches, we created an ensemble of differently hyper-parameterized systems, achieving a micro-F1-score of 0. 63 on the test data.
no code implementations • EACL 2017 • Silvana Hartmann, Ilia Kuznetsov, Teresa Martin, Iryna Gurevych
We create a novel test set for FrameNet SRL based on user-generated web text and find that the major bottleneck for out-of-domain FrameNet SRL is the frame identification step.
no code implementations • WS 2017 • Silvana Hartmann, {\'E}va M{\'u}jdricza-Maydt, Ilia Kuznetsov, Iryna Gurevych, Anette Frank
We present the first experiment-based study that explicitly contrasts the three major semantic role labeling frameworks.