1 code implementation • 28 Mar 2022 • Mor Geva, Avi Caciularu, Kevin Ro Wang, Yoav Goldberg
Transformer-based language models (LMs) are at the core of modern NLP, but their internal prediction construction process is opaque and largely not understood.