ThriftAttention: Selective Mixed Precision for Long-Context FP4 Attention

In three linesThriftAttention introduces selective mixed precision for optimized FP4 attention on long contexts. The method reduces memory consumption and accelerates inference by applying varying precision levels to critical attention regions.

Summary generated by Claude — human-verified