no code implementations • 29 Sep 2021 • Lukas Paul Achatius Galke, Isabelle Cuber, Christoph Meyer, Henrik Ferdinand Nölscher, Angelina Sonderecker, Ansgar Scherp
We match or exceed the scores of ELMo, and only fall behind more expensive models on linguistic acceptability.
no code implementations • 1 Jan 2021 • Lukas Paul Achatius Galke, Benedikt Franke, Tobias Zielke, Ansgar Scherp
In most cases, i. e., 15 out 18 experiments, we even observe that a temporal window of size 1 is sufficient to retain at least 90%.