Unsupervised Attention-based Sentence-Level Meta-Embeddings from Contextualised Language Models

no code implementations • LREC 2022 • Keigo Takahashi, Danushka Bollegala

A variety of contextualised language models have been proposed in the NLP community, which are trained on diverse corpora to produce numerous Neural Language Models (NLMs).

Semantic Textual Similarity Sentence +2