SuperInfer: SLO-Aware Rotary Scheduling and Memory Management for LLM Inference

In three linesSuperInfer introduces rotary scheduling and memory management for LLM inference optimized to meet SLO (Service Level Objectives). System-level approach to reduce latency and memory consumption.

Summary generated by Claude — human-verified