LaPA$^2$: Length-Aware Prefix and Prompt Attention Augmentation for Long-Form Controllable Text Generation

In three linesLaPA² addresses attention dilution in long-form controllable text generation. The method applies length-aware logarithmic scaling to amplify prefix attention weights, counteracting the natural decay of control signals. Training-free framework compatible with both soft and hard prefixes.

Summary generated by Claude — human-verified