Differentiable Belief-based Opponent Shaping

In three linesD-BOS (Differentiable Belief-based Opponent Shaping) is a MARL method that shapes opponents by differentiating through k-step softmax-Bayes belief dynamics. Unlike existing approaches, it treats belief state as the shaping target rather than parameters or policies. Results: outperforms PPO and BBM in hidden-role games, with largest gains in mixed-motive settings.

Summary generated by Claude — human-verified