Back to feed
arXiv cs.LG·

PJ-RoPE: A Fourier-Jet-Affine Position Space for Relative Attention

Signal
72
Hype
15
In three linesPJ-RoPE unifies RoPE's Fourier phase, Jordan-RoPE's finite jets, and ALiBi's affine recency into a single learnable relative-position space. The framework separates scalar PJ-bias kernels from exact PJ-rotary feature transforms, with adaptive sector diagnostics and LC/rapidity coordinates to stabilize high-order jets.
Read source
Your take?
ReasoningBenchmarksPapers

Summary generated by Claude — human-verified