Length-Aware Multi-Kernel Transformer for Long Document Classification

1 code implementation • 11 May 2024 • Guangzeng Han, Jack Tsao, Xiaolei Huang

LAMKIT encodes lengthy documents by diverse transformer-based kernels for bridging context boundaries and vectorizes text length by the kernels to promote model robustness over varying document lengths.

Document Classification Sentence