EmbGen: Teaching with Reassembled Corpora

In three linesEmbGen is a synthetic data generation pipeline that decomposes a corpus into entity-description pairs, reassembles them via embedding similarity, then generates QA pairs with proximity and cluster-specialized sampling. On three datasets, EmbGen improves Binary Accuracy by 12.5% (5M tokens) to 88.9% (20M tokens) on the most heterogeneous dataset versus baselines.

Summary generated by Claude — human-verified