Beyond LoRA vs. Full Fine-Tuning: Gradient-Guided Optimizer Routing for LLM Adaptation

In three linesNew MoLF (Mixture of LoRA and Full) method combines full fine-tuning and LoRA via dynamic optimizer-level routing. Tested on Gemma-3-1B, Qwen2.5-1.5B/3B across SQL, Medical QA, Counterfactual Knowledge. MoLF-Efficient outperforms adaptive LoRA approaches by 20% (Fact) and 9% (Med/SQL). Code open-sourced.

Summary generated by Claude — human-verified