Semantic Motion Anchors: Bridging Motion and Meaning in Co-Speech Gestures
Method to align speech and co-speech gestures using semantic motion anchors: discretizes 3D gestures into motion primitives, verbalizes them into structured descriptions, and provides contrastive supervision. 8.2% R@1 improvement on BEAT2; retrieved gestures are semantically meaningful rather than generic motion patterns.