Search Results for author: Mahdi Nikdan

Found 2 papers, 2 papers with code

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation

1 code implementation9 Jan 2024 Mahdi Nikdan, Soroush Tabesh, Elvir Crnčević, Dan Alistarh

We investigate parameter-efficient fine-tuning (PEFT) methods that can provide good accuracy under limited computational and memory budgets in the context of large language models (LLMs).

Math Quantization

SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks

1 code implementation9 Feb 2023 Mahdi Nikdan, Tommaso Pegolotti, Eugenia Iofinova, Eldar Kurtic, Dan Alistarh

We provide a new efficient version of the backpropagation algorithm, specialized to the case where the weights of the neural network being trained are sparse.

Transfer Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.