Hallucinations as Orthogonal Noise: Inference-Time Manifold Alignment via Dynamic Contextual Orthogonalization

In three linesNew inference-time method DCO (Dynamic Contextual Orthogonalization) to reduce hallucinations in LLMs. Based on hypothesis that hallucinations manifest as orthogonal noise relative to semantic manifold of residual stream. Evaluated on Llama-3 (8B/70B) with improvements on XSum, NQ-Swap, IFEval and TriviaQA.

Summary generated by Claude — human-verified