Bilingual Dictionary-based Language Model Pretraining for Neural Machine Translation

no code implementations • 12 Mar 2021 • Yusen Lin, Jiayong Lin, Shuaicheng Zhang, Haoying Dai

Recent studies have demonstrated a perceivable improvement on the performance of neural machine translation by applying cross-lingual language model pretraining (Lample and Conneau, 2019), especially the Translation Language Modeling (TLM).

Language Modelling Machine Translation +1