Thinking with Patterns: Breaking the Perceptual Bottleneck in Visual Planning via Pattern Induction

In three linesVLMs struggle with planning from complex visual inputs. This paper proposes Pattern Induction, an online inductive learning strategy that discovers and optimizes reusable visual patterns as composite experts. Pattern Inference enables VLMs to recognize these patterns and directly infer world model structures. Evaluated on FrozenLake, Crafter, and CubeBench.

Summary generated by Claude — human-verified