From Volume to Value: Preference-Aligned Memory Construction for On-Device RAG

In three linesEPIC (Efficient Preference-aligned Index Construction) optimizes on-device RAG by storing user preferences instead of raw data. Across 4 benchmarks, reduces indexing memory by 2404×, improves preference-following accuracy by 20.17 percentage points, and lowers retrieval latency by 33.33×. Memory footprint under 1 MB with 29.35 ms/query.

Summary generated by Claude — human-verified