mt5 is a multilingual variant of T5 that was pre-trained on a new Common Crawl-based dataset covering $101$ languages.
Source: mT5: A massively multilingual pre-trained text-to-text transformerPaper | Code | Results | Date | Stars |
---|
Task | Papers | Share |
---|---|---|
Language Modelling | 15 | 7.18% |
Question Answering | 14 | 6.70% |
Machine Translation | 12 | 5.74% |
Decoder | 12 | 5.74% |
Translation | 12 | 5.74% |
Natural Language Understanding | 9 | 4.31% |
Cross-Lingual Transfer | 9 | 4.31% |
XLM-R | 8 | 3.83% |
Abstractive Text Summarization | 7 | 3.35% |