Distributional Alignment as a Criterion for Designing Task Vectors in In-Context Learning

In three linesNew d_NTP metric evaluates task vector quality in ICL by measuring alignment of next-token probability distributions. Linear Task Vector (LTV) method minimizes d_NTP via closed-form linear regression, improves accuracy by 9.2% across 8 benchmarks and 5 LLMs, reduces inference latency. Task vectors transferable across model scales (+6.4% for smaller model).

Summary generated by Claude — human-verified