Exploring the Impact of Corpus Diversity on Financial Pretrained Language Models

1 code implementation • 20 Oct 2023 • Jaeyoung Choe, Keonwoong Noh, Nayeon Kim, Seyun Ahn, Woohwan Jung

Over the past few years, various domain-specific pretrained language models (PLMs) have been proposed and have outperformed general-domain PLMs in specialized areas such as biomedical, scientific, and clinical domains.

Language Modelling Sentiment Analysis