ST-MoE-L 4.1B (fine-tuned)
1 papers with code • 0 benchmarks • 0 datasets
Benchmarks
These leaderboards are used to track progress in ST-MoE-L 4.1B (fine-tuned)
Most implemented papers
ST-MoE: Designing Stable and Transferable Sparse Expert Models
tensorflow/mesh
•
•
But advancing the state-of-the-art across a broad set of natural language tasks has been hindered by training instabilities and uncertain quality during fine-tuning.
