Search Results for author:
Found 1 papers, 0 papers with code
Towards Understanding Inductive Bias in Transformers: A View From Infinity
We study inductive bias in Transformers in the infinitely over-parameterized Gaussian process limit and argue transformers tend to be biased towards more permutation symmetric functions in sequence space.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
