1 code implementation • 23 May 2023 • Arseny Moskvichev, Ky-Vinh Mai
We show that our questions 1) adequately represent the source material 2) can be used to diagnose a model's memory capacity 3) are not trivial for modern language models even when the memory demand does not exceed those models' context lengths.