Alignment Tuning for Large Language Models: A Data-Centric Lens on Alignment Data Pipelines

In three linesSurvey of alignment data pipelines for LLMs. Decomposes construction into three stages: response synthesis, preference evaluation, preference instantiation. Identifies recurring design trade-offs and principles clarifying how pipeline choices influence optimization signal.

Summary generated by Claude — human-verified