Five articles published the same day, five benchmarks. Not an editorial coincidence — a structural signal. The RL/LLM community has entered an instrumentation phase: before scaling, it documents what doesn't work. RL4F (arXiv:2606.07550) is the clearest example: an offline RL benchmark on real DIII-D tokamak data, four multi-actuator plasma control tasks, and a sober conclusion — offline model-based methods lead, but nobody claims fusion control is solved. ResearchClawBench drives the point home on the agent side: Claude Code at 21.5/100 and Claude-Opus at 20.7/100 across 40 autonomous scientific research tasks. These scores aren't model failures — they're failures in experimental protocols and evidence matching, which is precisely what agents need to master to be useful in science.
UniQL (arXiv:2606.08018) completes the picture on text-to-SQL: 24,544 queries, 16 dialects (MySQL, PostgreSQL, T-SQL…), and cross-dialect generalization that collapses systematically. For teams deploying NL-to-SQL pipelines in production on heterogeneous stacks, this is a concrete warning — the model that performs on Spider doesn't hold on T-SQL. Pair that with llama.cpp PR #24225 on ggml-webgpu: measured speedups on M2 Pro ranging from 1.33x (Q5_K) to 3.78x (Q3_K_M) on prefill pp512. Not research — low-level engineering that makes k-quants viable on web GPUs, relevant for anyone deploying quantized models client-side.
The Parakeet case is the most actionable of the batch. Omi Med STT v1, a CC-BY-4.0 fine-tune of Parakeet TDT 0.6B, hits 2.37% M-WER on clinical terms versus 8.36% for the base model, outperforming Whisper Large v3 Turbo and Qwen3 ASR on 1,513 medical clips at 145× RTFx. MLX/NeMo/GGUF runtime, deployable on local Mac. This is the exact template of what niche fine-tuning can produce when the task is well-scoped and test data is representative — a direct counterpoint to the ResearchClawBench scores, which confirm that open-ended tasks remain out of reach.
RL4F is an open-source offline reinforcement learning benchmark for plasma control in nuclear fusion. Built on historical data from the DIII-D tokamak, it evaluates imitation learning and offline RL methods on four multi-actuator tracking tasks (rotation, density, temperature, pressure). Offline model-based RL methods achieve best average performance.
ResearchClawBench benchmarks autonomous scientific research agents across 40 tasks spanning 10 scientific domains. Claude Code scores 21.5/100, Claude-Opus 20.7/100. Failures concentrate in experimental protocol mismatch, evidence mismatch, and missing scientific core.
UniQL is a benchmark of 24,544 SQL queries across 16 dialects (MySQL, PostgreSQL, T-SQL, etc.) to evaluate LLM generalization in text-to-SQL tasks. Experiments show current LLMs fail to generalize across dialects, with substantial performance variation across database systems.
llama.cpp PR improves matmul performance for k-quants via WebGPU. Speedups measured on M2 Pro: Q2_K 2.44x, Q3_K 3.27-3.78x, Q4_K 1.34-1.36x, Q5_K 1.33x, Q6_K 1.44-1.52x in prefill (pp512).
Fine-tuned Parakeet 0.6B for medical transcription, open weights (CC-BY-4.0). Omi Med STT v1 achieves 2.37% M-WER (clinical term errors) vs 8.36% baseline, 145× RTFx. Multi-platform runtime (MLX/NeMo/GGUF). Benchmark on 1,513 medical clips: outperforms Whisper Large v3 Turbo and Qwen3 ASR on clinical accuracy.