Signs Beat Floats: Low-Rank Double-Binary Adaptation for On-Device Fine-Tuning

In three linesLoRDBA replaces low-rank LoRA adapter factors with binary sign carriers and channel-wise magnitude scales, reducing adapter footprint by over 10× while matching fp16 LoRA quality. Outperforms low-bit baselines at matched model sizes with ≤8% prefill latency overhead and ~1.6× training memory overhead versus fp16 LoRA.

Summary generated by Claude — human-verified