Preference Optimization for Vision Language Models

In three linesHugging Face introduces preference optimization for vision-language models. The method improves VLM alignment with human preferences without explicit reward data, using pairwise comparisons of images and text.

Summary generated by Claude — human-verified