Introduction to LLM API Benchy

In three linesLLM Benchy is a unified benchmarking tool for comparing LLM endpoint performance. Inspired by 3D printer Benchy tests, it enables standardized testing across any LLM endpoint with metrics like tokens/s and latency across 11 categories (coding, math, reasoning, etc.). Open GitHub repo accepting contributions.

Summary generated by Claude — human-verified