SciDeBERTa: Learning DeBERTa for Science Technology Documents and Fine-Tuning Information Extraction Tasks

1 code implementation • IEEE Access 2022 • Yuna Jeong, Eunhui Kim

Experiments verified that SciDeBERTa(CS) continually pre-trained in the computer science domain achieved 3. 53% and 2. 17% higher accuracies than SciBERT and S2ORC-SciBERT, respectively, which are science technology domain specialized PLMs, in the task of recognizing entity names in SciERC dataset.

General Knowledge Joint Entity and Relation Extraction +1