FedSDR: Federated Self-Distillation with Rectification

In three linesFedSDR addresses federated fine-tuning of LLMs under statistical heterogeneity. The method combines self-distillation (FedSD) with a dual-stream mechanism: a local LoRA-S branch to absorb heterogeneity via distilled data, and a parallel global LoRA-R branch anchored to raw data for factual correctness.

Summary generated by Claude — human-verified