Search Results for author: Fangzhao Zhang

Found 3 papers, 1 papers with code

Spectral Adapter: Fine-Tuning in Spectral Space

no code implementations22 May 2024 Fangzhao Zhang, Mert Pilanci

Recent developments in Parameter-Efficient Fine-Tuning (PEFT) methods for pretrained deep neural networks have captured widespread interest.

Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models

1 code implementation4 Feb 2024 Fangzhao Zhang, Mert Pilanci

In this work we study the enhancement of Low Rank Adaptation (LoRA) fine-tuning procedure by introducing a Riemannian preconditioner in its optimization step.

Cannot find the paper you are looking for? You can Submit a new open access paper.