AST-Probe: Recovering abstract syntax trees from hidden representations of pre-trained language models

no code implementations • 23 Jun 2022 • José Antonio Hernández López, Martin Weyssow, Jesús Sánchez Cuadrado, Houari Sahraoui

Using probes, a technique to study the linguistic properties of hidden vector spaces, previous works have shown that these pre-trained language models encode simple linguistic properties in their hidden representations.