CONCORD: Asynchronous Sparse Aggregation for Device-Cloud RAG under Document Isolation

In three linesCONCORD is an asynchronous sparse aggregation framework for device-cloud RAG with document isolation. It uses waiting debt control and certificate-guided minimal supplementation to reduce synchronization and data transfer. Improves end-to-end throughput by 1.66× to 2.15× on Natural Questions and WikiText-2 while reducing per-token communication by over 100×.

Summary generated by Claude — human-verified