Czert – Czech BERT-like Model for Language Representation

1 code implementation • RANLP 2021 • Jakub Sido, Ondřej Pražák, Pavel Přibáň, Jan Pašek, Michal Seják, Miloslav Konopík

This paper describes the training process of the first Czech monolingual language representation models based on BERT and ALBERT architectures.

MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain

2 code implementations • 26 Mar 2022 • Jan Pašek, Jakub Sido, Miloslav Konopík, Ondřej Pražák

This work proposes a new pipeline for leveraging data collected on the Stack Overflow website for pre-training a multimodal model for searching duplicates on question answering websites.

Question Answering

Czert -- Czech BERT-like Model for Language Representation

1 code implementation • 24 Mar 2021 • Jakub Sido, Ondřej Pražák, Pavel Přibáň, Jan Pašek, Michal Seják, Miloslav Konopík

This paper describes the training process of the first Czech monolingual language representation models based on BERT and ALBERT architectures.