Zero-order Parameter-free Optimization for LMO-based Methods: Novel Approach for Efficient Fine-tuning

In three linesNovel AdaNAGED algorithm for parameter-free, zero-order optimization in LLM fine-tuning. Reduces memory overhead of backpropagation via linear minimization oracles and adaptive geometry-aware updates. Validated on OPT-1.3B model.

Summary generated by Claude — human-verified