Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
We study the computational limits of Low-Rank Adaptation (LoRA) update for finetuning transformer-based models using fine-grained complexity theory.
Computational Limits