DenseSteer: Steering Small Language Models towards Dense Math Reasoning

In three linesDenseSteer is a training-free inference-time steering method that enhances mathematical reasoning in small models (≤3B parameters) by modulating internal representations toward dense reasoning patterns. On Qwen-2.5, the approach shows that more proficient reasoning uses fewer steps but higher information density per step.

Summary generated by Claude — human-verified