Search Results for author:
Found 2 papers, 2 papers with code
IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact
Such outliers are found to allocate most of the attention scores on initial tokens of input, termed as pivot tokens, which are crucial to the performance of quantized LLMs.
Learning Imbalanced Data with Vision Transformers
In this paper, we systematically investigate the ViTs' performance in LTR and propose LiVT to train ViTs from scratch only with LT data.
Ranked #7 on
Long-tail Learning
on CIFAR-10-LT (ρ=10)
Cannot find the paper you are looking for? You can
Submit a new open access paper.
