DIVE: Embedding Compression via Self-Limiting Gradient Updates

In three linesDIVE compresses LLM embeddings through lightweight adapters using self-limiting triplet loss and NT-Xent contrastive loss. Outperforms Matryoshka-Adaptor, Search-Adaptor, and SMEC across 6 BEIR datasets at all compression ratios. 14M-parameter open-source implementation.

Summary generated by Claude — human-verified