PACUTE: Phonology-, Affix-, and Character-level Understanding of Tokens for Filipino

In three linesPACUTE is a 4,600-task benchmark evaluating morphological understanding of Filipino in LLMs. The benchmark tests 6 compositional levels including infixation, reduplication, and diacritic distinctions. Open-weight models perform near chance on morpheme decomposition; frontier models recover affixes but remain far below ceilings on morphological composition tasks.

Summary generated by Claude — human-verified