Which LoRA? An Empirical Study on the Effectiveness of LoRA Techniques During Multilingual Instruction Tuning

In three linesEmpirical study comparing LoRA and 4 variants on multilingual instruction tuning. Results: no significant advantage of complex variants over basic LoRA for balancing cross-lingual transfer and knowledge retention. Embedding analysis shows layer-wise language representations remain similar across LoRA techniques.

Summary generated by Claude — human-verified