Search Results for author:
Found 2 papers, 1 papers with code
Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking
We identify the mechanism that enables entity tracking and show that (i) in both the original model and its fine-tuned versions primarily the same circuit implements entity tracking.
Linearity of Relation Decoding in Transformer Language Models
Linear relation representations may be obtained by constructing a first-order approximation to the LM from a single prompt, and they exist for a variety of factual, commonsense, and linguistic relations.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
