Optuna Constrained Tree-Structured Parzen Estimator Is a Joint Density Generalization of c-TPE

In three linesTheoretical analysis of Optuna's constrained TPE algorithm. Authors show Optuna uses joint density over objective and constraints, unlike c-TPE which assumes independence. Joint formulation is invariant to constraint duplication while independent c-TPE degrades with duplicated factors.

Summary generated by Claude — human-verified