Browse State-of-the-Art
Datasets
Methods
More
Newsletter
RC2022
About
Trends
Portals
Libraries
Sign In
Subscribe to the PwC Newsletter
×
Stay informed on the latest trending ML papers with code, research developments, libraries, methods, and datasets.
Read previous issues
Join the community
×
You need to
log in
to edit.
You can
create a new account
if you don't have one.
Edit Category
×
Description with markdown (optional):
Image
Language Model Pre-Training
Edit
Natural Language Processing
• 4 methods
Methods
Add a Method
Method
Year
Papers
MPNet
MPNet: Masked and Permuted Pre-training for Language Understanding
2020
12
ERNIE-GEN
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation
2020
1
ReasonBERT
ReasonBERT: Pre-trained to Reason with Distant Supervision
2021
1
K3M
Knowledge Perceived Multi-modal Pretraining in E-commerce
2021
1