Search Results for author: Adjorn van Engelenhoven

Found 1 papers, 0 papers with code

CAST: Clustering Self-Attention using Surrogate Tokens for Efficient Transformers

no code implementations6 Feb 2024 Adjorn van Engelenhoven, Nicola Strisciuglio, Estefanía Talavera

The self-attention from within each cluster is then combined with the cluster summaries of other clusters, enabling information flow across the entire input sequence.

Clustering

Cannot find the paper you are looking for? You can Submit a new open access paper.