SpecHop: Continuous Speculation for Accelerating Multi-Hop Retrieval Agents

In three linesSpecHop accelerates multi-hop retrieval agents by maintaining multiple speculative threads with faster but less reliable tools, asynchronously verifying predictions and committing/rolling back branches. The framework reduces latency by up to 40% while preserving accuracy and final trajectory, approaching oracle latency gains with sufficient active threads.

Summary generated by Claude — human-verified