Beacon: Single-Turn Diagnosis and Mitigation of Latent Sycophancy in Large Language Models

In three linesBeacon is a diagnostic benchmark measuring sycophancy (LLMs' tendency to prioritize user agreement over factual accuracy) across 12 SOTA models. Authors identify stable linguistic and affective sub-biases scaling with model capacity, and propose prompt-level and activation-level interventions to modulate them.

Summary generated by Claude — human-verified