no code implementations • 18 Jun 2022 • Sergey Vychegzhanin, Evgeny Kotelnikov
The method is based on two interacting models: the autoregressive language ruGPT-3 model and the autoencoding language ruRoBERTa model.
no code implementations • 19 Nov 2021 • Elena Razova, Sergey Vychegzhanin, Evgeny Kotelnikov
We fine-tune RuBERT on sentiment text corpora and compare the distributions of attention weights for sentiment and neutral lexicons.