Efficient On-Device Diffusion LLM Inference with Mobile NPU

In three linesllada.cpp is the first NPU-aware inference framework accelerating diffusion LLMs on mobile devices. Three techniques optimize execution: Multi-Block Speculative Decoding, Dual-Path Progressive Revision, and Swap-Optimized Memory Runtime. LLaDA-8B achieves 17x-42x latency reduction vs CPU baseline.

Summary generated by Claude — human-verified