LCO: LLM-based Constraint Optimization for Safer Agentic LLMs in Real-world Tasks

In three linesLCO (LLM-based Constraint Optimization) is a framework reducing in-context reward hacking (ICRH) in autonomous LLMs without fine-tuning. Two modules: self-thought for integrating safety constraints, and evolutionary sampling to keep actions in safe solution space. On GPT-4, achieves 39% reduction in toxicity growth rate and 15.23% reduction in ICRH occurrence.

Summary generated by Claude — human-verified