ToolMenuBench: Benchmarking Tool-Menu Filtering Strategies for Reliable and Efficient LLM Agents

In three linesToolMenuBench is a benchmark evaluating how tool-menu construction affects reliability and efficiency of multi-step LLM agents. Across 7 model backends, causal minimal tool filtering (CMTF) improves task success from 32.1% to 85.7% and reduces token usage by 98%, while minimizing wrong-tool calls and risky-tool exposure.

Summary generated by Claude — human-verified