AstroMind: A High-Fidelity Benchmark for Spacecraft Behavior Reasoning Based on Large Language Models

In three linesAstroMind is a benchmark for evaluating LLM reasoning on spacecraft behavior. Built on high-fidelity astrodynamics simulations, it tests intent inference, maneuver parameter estimation, and threat assessment. Qwen3 (32B) leads intent inference, QwQ (32B) leads threat assessment, GPT-OSS (20B) produces strongest reasoning quality.

Summary generated by Claude — human-verified