no code implementations • 22 May 2024 • Fangzhao Zhang, Mert Pilanci
Recent developments in Parameter-Efficient Fine-Tuning (PEFT) methods for pretrained deep neural networks have captured widespread interest.
1 code implementation • 4 Feb 2024 • Fangzhao Zhang, Mert Pilanci
In this work we study the enhancement of Low Rank Adaptation (LoRA) fine-tuning procedure by introducing a Riemannian preconditioner in its optimization step.
no code implementations • 3 Feb 2024 • Fangzhao Zhang, Mert Pilanci
Diffusion models are gaining widespread use in cutting-edge image, video, and audio generation.