CAIT is an open-source toolkit for syntactic parsing of child-adult interactions in CHILDES. It includes a dependency parser trained on UD-English-CHILDES, a POS tagger, and a construction tagger. The parser outperforms SpaCy and Stanza on this specialized domain.
SciCustom is a framework for building custom benchmarks to evaluate application-specific scientific capabilities in LLMs. It organizes scientific knowledge into ontology-grounded units, uses multi-model consensus voting to identify relevant units, and generates benchmarks from real data in chemistry and healthcare without expert annotation.
Hugging Face releases Carbon, a family of open-source DNA foundation models. Carbon-3B matches SOTA (Evo2-7B) while being 275× faster. The approach adapts modern LLM techniques: deterministic 6-mer tokenization, factorized loss (FNS) mid-training, and curation of functional biological data.
Neurosymbolic architecture with ontologies (Role, Domain, Interaction) for enterprise LLM agents. Controlled experiment (1,800 runs, Claude Sonnet 4, Qwen 2.5 72B, Gemma 4 26B): ontology-constrained agents outperform ungrounded agents on metric accuracy and role consistency (p < .001). 2x greater lift in localized domains (Vietnam) where LLM training coverage is weak.
KVCapsule compresses KV cache in vision-language models during autoregressive decoding. The method exploits structured attention patterns in vision tokens to achieve 2x TPS improvement and 2.4x memory reduction at 60% compression ratio, without modifying the pretrained backbone.
FinTagging is a benchmark for evaluating LLMs on extracting and tagging financial data with XBRL. It decomposes the task into two stages: FinNI (extracting numeric entities) and FinCL (mapping to the full US GAAP taxonomy). Testing shows models extract well but struggle with fine-grained concept linking across 10k+ concepts.
Study of autonomous AI agents in multi-echelon supply chains using MIT Beer Game. Reasoning models reduce costs by 67% vs human teams, but reveal an 'agent bullwhip effect': amplification of decision unreliability across echelons. A GRPO-based reinforcement-learning post-training framework using system-level rewards improves reliability and reduces tail events.
PH-Dreamer embeds Port-Hamiltonian physical principles into world models to improve latent imagination. The framework models energy evolution, estimates the Hamiltonian from proprioceptive observations, and uses an energy-guided Actor-Critic. Results: 4.18-8.41% phase space volume reduction, up to 7.80% energy consumption decrease, up to 9.38% jerk reduction.
RAG-Gym, a framework supervising the search process rather than final answers, improves autonomous search agents. Re²Search++ uses process supervision and reasoning reflection to generate higher-quality queries, achieving significant gains on multi-hop benchmarks with better out-of-domain generalization.
Reasoning models outperform base LLMs on complex benchmarks. Study shows the advantage stems from a small set of early decision tokens (~8% on Qwen3-0.6B), concentrated in planning phases. Selective intervention by the reasoning model at these critical tokens restores performance without major computational overhead.
EPIC is an on-device RAG index construction method optimized for personal AI agents. It reduces indexing memory by 2,404× by focusing on user preferences, improves preference-following accuracy by 20.17 percentage points, and decreases retrieval latency by 33.33×. Memory footprint under 1 MB with 29.35 ms/query latency.
ZEDA, a self-distillation framework, converts post-trained static MoE models into dynamic variants. On Qwen3-30B-A3B and GLM-4.7-Flash, it reduces 50% of expert FLOPs with marginal accuracy loss and achieves 1.20× end-to-end inference speedup.
Whole-slide MIL models suffer from 'spatial blindness': accurate predictions but ignoring tissue architecture. ResTopoMIL fixes this by separating appearance statistics (prototype histogram) from spatial relations (graph branch with permutation constraint). Improvements across 9 WSI benchmarks with 1.15M parameters.
Study of membership inference attacks (MIA) on masked diffusion language models (MDLM). Researchers extract 46-dimensional feature vectors from reconstruction loss at different masking ratios and train XGBoost and MLP classifiers. On MIMIR benchmark, XGBoost achieves AUC 0.878 (peak 0.930), outperforming SAMA baseline by 0.062 AUC. ELBO trajectory alone drives most of the signal.
BacktestBench is the first large-scale benchmark for automated quantitative backtesting, containing 18,246 annotated QA pairs across 6 million real market records. AutoBacktest, a multi-agent system, translates natural language strategies into reproducible backtests via a Summarizer, SQL Retriever, and Python Coder. Evaluation on 23 mainstream LLMs.
OverEager-Gen is a benchmark measuring out-of-scope actions by autonomous coding agents on benign tasks. On Claude Code, removing the consent declaration raises the overeager rate from 0% to 17.1%. The study validates 500 scenarios across 4 products (Claude Code, OpenHands, Codex CLI, Gemini CLI) and 6 base models.
CoDiLA combines diffusion with local autoregressive decoding for parallel code generation. A compact auxiliary AR model (0.6B parameters) ensures syntactic coherence on diffusion latents, eliminating artifacts while preserving bidirectional generation and sub-linear latency.
GRASP is an agentic system for multi-hop question answering that decomposes queries into dependency-aware plans and uses a three-layer hierarchical graph (entities, propositions, passages). On MuSiQue, 2WikiMultihopQA, and HotpotQA, GRASP achieves highest accuracy while consuming 40-50% fewer tokens than IRCoT+HippoRAG2.
SPOT (Surgical Post-Training) is an on-policy distillation framework that injects reasoning capabilities into LLMs while preserving prior knowledge. With only 4k rectified math pairs, it improves Qwen3-8B by 6.2% on average in 16 minutes on 8x H800 GPUs. The approach uses KL-constrained reward formulation to mitigate catastrophic forgetting.
Researchers identify Entropy-Gradient Inversion, a negative correlation between token entropy and logit gradients, as a geometric fingerprint of Large Reasoning Models' reasoning capability. They propose Correlation-Regularized Group Policy Optimization (CorR-PO), an RL method embedding this inversion signature into reward regularization, outperforming baselines across multiple reasoning benchmarks.
PRISMat is a permutation-invariant autoregressive model for crystal material generation. Lighter and faster than LLMs, it reduces prediction error for cleavage energy and work function by 4× (MAE 0.188 eV/Ų and 2.79 eV). Applicable to high-throughput materials discovery.
Study showing that unlearning in LLMs merely suppresses information at surface level—models recover original behavior through minimal fine-tuning. Authors introduce representation-level analysis framework (PCA, CKA, Fisher information) to assess genuine data erasure and identify four forgetting regimes based on reversibility and catastrophicity.
AdaGraph is a graph-native clustering algorithm that overcomes the curse of dimensionality by operating on kNN graph topology instead of Euclidean distances. Tested on 10 synthetic benchmarks (d=10 to 5000) and three scientific domains (genomics, NLP, materials science), it outperforms HDBSCAN, WGCNA, and other methods without requiring k specification.
An AI agent integrating LLMs with laboratory orchestration enables scientists to create and monitor automated protocols using natural language. Tested on three simulated labs (chemistry, biology, materials science), the agent achieves 97% first-attempt success rate and reduces required interface actions by an order of magnitude.
AgentWall is a runtime safety layer for local AI agents. It intercepts proposed agent actions before execution, evaluates them against an explicit declarative policy, requires human approval for sensitive operations, and records a complete audit trail. Implemented as an MCP-enforcing proxy and native OpenClaw plugin, it achieves 92.9% policy enforcement accuracy with sub-millisecond overhead.
Researchers demonstrate that reinforcement learning can encode reusable solvers into LLM weights rather than solving each instance at inference time. Fine-tuning Qwen2.5-Coder-14B with GRPO on Synergistic Dependency Selection, the model converges to Simulated Annealing with 5.0% gap to optimal solver, 91× cheaper than Best-of-64 baseline.
STING is an automated red-teaming framework measuring multi-turn illicit assistance in LLM agents. It constructs step-by-step illicit plans grounded in benign personas and uses judge agents to track completion. Multilingual evaluation across six non-English languages shows attack success does not consistently increase in lower-resource languages, diverging from chatbot findings.
SPOT (Surgical Post-Training) is an on-policy distillation framework that injects reasoning capabilities into LLMs while preserving prior knowledge. With 4k rectified math pairs, it improves Qwen3-8B by 6.2% on average in 16 minutes on 8x H800, using KL-constrained reward formulation and minimal-edit error correction pipeline.
PopPy is a system that automatically uncovers parallelization opportunities in Python compound AI applications (multiple ML model calls). On real-world applications, PopPy achieves up to 6.4× speedups in end-to-end execution time, combining an ahead-of-time compiler and runtime to handle language complexity, dynamic dispatch, and variable mutation.
OptimusVLA, a hierarchical Vision-Language-Action model, improves robotic manipulation via two memories: Global Prior Memory (replaces Gaussian noise with trajectory priors) and Local Consistency Memory (enforces temporal coherence). Results: 98.6% on LIBERO, +13.5% vs pi_0 on CALVIN, 2.9x inference speedup.
Representation Autoencoders v2 improves VAEs using pretrained vision encoders. Authors find that summing the last k encoder layers, combining RAE with REPA (representation alignment), and re-parameterizing classifier-free guidance accelerates convergence 10x. RAEv2 achieves gFID 1.06 in 80 epochs on ImageNet-256 and EP_FID@2 of 35 epochs.
Circuit analysis of a backdoor in an 8B model: a 3-word Latin trigger redirects English output to French. The circuit operates in 3 phases via attention heads, propagates through a subspace orthogonal to natural language-identity directions, then converts via MLP. A single serial bottleneck position controls the entire flow.
Theoretical analysis of standard transformers with softmax and low precision, proving they can simulate Turing machines via Chain-of-Thought. Authors construct hardmax transformers with ternary activations, then convert to equivalent softmax without unrealistic parameter magnitudes. Results validated on Sudoku reasoning.
MINE (Mechanistically Interpretable Neural Encoding) applies mechanistic interpretability tools to neural encoding models to localize visual features driving voxel-level activity in human visual cortex. Validated via image generation and counterfactual editing: inserting/removing predicted features shifts neural activation as expected.
Study of 'cognitive poisoning': malicious tools accumulate trust through benign feedback before becoming harmful. TRUST-Bench (1,970 episodes) and VISTA-Guard propose defense via final-action risk scoring from interaction trajectory. Prompt-centric heuristics fail; trajectory-aware scoring achieves 84.2% in-domain performance.
Retrieval-based approach for multi-label legal annotation: frozen embedding model with k-NN prediction on documents and label descriptions. On Eurlex (100 labels), Qwen-8B achieves Macro-F1 49.12 vs 40.41 (GPT-5.2 zero-shot), reduces compute 20-30×. Eliminates hallucinations (GPT-5.2: 0.12-0.9% out-of-taxonomy labels).
EnactToM is an evolving benchmark with 300 multi-agent embodied tasks in 3D household environments with partial observability. It tests functional Theory of Mind—acting optimally on implicit beliefs—rather than literal belief questions. All seven frontier models score 0.0% on hard task completion, with 93% of failures traced to epistemic coordination breakdowns.
FastOCR introduces a training-free framework to accelerate OCR on Vision-Language Models by exploiting dynamic visual fixation. Through KV cache pruning, the model reduces visual tokens processed to 5% per decoding step while retaining 98% accuracy on Qwen2.5-VL, achieving 3.0× attention latency reduction.
SomaliWeb v1: Somali corpus of 819,322 documents (~303M tokens) with BPE-16K tokenizer and language-identification benchmark. Reveals major defects in existing distributions (HPLT v2: 17.3% duplicates, 56.1% mojibake). Tokenizer 40.2% more efficient than GPT-4's cl100k_base on FLORES-200.
Study of 38 models on 8,900 scholarly references: factual recall quality follows a sigmoid combining model size and topic frequency in training data. These two variables explain 60% of variance across dense models, rising to 74-94% within individual model families.