Search Results for author:
Found 2 papers, 1 papers with code
Low-Rank Quantization-Aware Training for LLMs
Unlike most related work, our method (i) is inference-efficient, leading to no additional overhead compared to traditional PTQ; (ii) can be seen as a general extended pretraining framework, meaning that the resulting model can still be utilized for any downstream task afterwards; (iii) can be applied across a wide range of quantization settings, such as different choices quantization granularity, activation quantization, and seamlessly combined with many PTQ techniques.
RATT: Recurrent Attention to Transient Tasks for Continual Image Captioning
We call our method Recurrent Attention to Transient Tasks (RATT), and also show how to adapt continual learning approaches based on weight egularization and knowledge distillation to recurrent continual learning problems.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
