Archives

June 2026

2731 articles

arXiv cs.CL·

VoidPadding: Let [VOID] Handle Padding in Masked Diffusion Language Models so that [EOS] Can Focus on Semantic Termination

VoidPadding introduces a dedicated [VOID] token for padding in masked diffusion language models (MDLMs), freeing [EOS] for semantic termination. On Dream-7B-Instruct, it improves mathematical reasoning and code generation benchmarks by +17.84 points over baseline and +6.95 over RainbowPadding, reducing NFE by 55.7%.

Code generationReasoningBenchmarks
SIG
72
HYP
25
arXiv cs.CL·

Dynamic Rollout Editing for Reducing Overthinking in RL-Trained Reasoning Models

RL-trained reasoning models often generate unnecessary reasoning after finding the correct answer (overthinking). This paper introduces Dynamic Rollout Editing (DRE), a training-time intervention during GRPO that edits successful trajectories continuing after answer emergence, preserving the verified prefix and weakening preference signals for unnecessary thinking.

Reinforcement learningReasoning
SIG
78
HYP
15
arXiv cs.AI·

DiagFlowBench: Evaluating How Language Models Handle Off-Procedure Inputs in Grounded Diagnostic Dialogue

DiagFlowBench evaluates how language models handle off-procedure inputs in industrial diagnostic dialogue. A dataset of 1,676 multi-turn conversations derived from 50 diagnostic flowcharts reveals models often select a real but contextually inadequate step rather than hallucinate, exposing a vulnerability: plausible but wrong advice grounded in documentation.

BenchmarksEvalsReasoning
SIG
75
HYP
15
arXiv cs.CL·

Evaluating Large Language Models Abilities for Addressee, Turn-change, and Next Speaker Prediction in Meetings

Comparative study of LLM abilities to predict next speaker, turn changes, and addressee in multi-party conversations. On the AMI corpus, LLMs outperform supervised models and humans in next speaker prediction without audio-visual access. MM-LLMs exceed text-based LLMs but remain below human performance for addressee and turn-change prediction.

BenchmarksEvalsVision
SIG
72
HYP
18
arXiv cs.CL·

OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation

OPD-Evolver is a slow-fast co-evolution framework that cultivates self-evolving agents through on-policy self-distillation. The system manages a four-level memory hierarchy to read, use, write, and maintain experience. Across multi-domain benchmarks, OPD-Evolver outperforms ReasoningBank (+11.5%) and Skill0 (+5.8%), with OPD-Evolver-9B rivaling Qwen3.5-397B and Step-3.5-Flash.

AI AgentsReasoningReinforcement learning
SIG
72
HYP
35
arXiv cs.CL·

An expressivity analysis of hierarchical modelling in deep transformers via bounded-depth grammars

Theoretical analysis of deep transformer expressiveness through bounded-depth, non-recursive context-free grammars. Authors explicitly construct transformers with positional attention whose depth scales linearly with grammar depth, demonstrating these architectures can encode abstract grammatical states into linearly separable subspaces within the residual stream.

PapersReasoningBenchmarks
SIG
78
HYP
15
arXiv cs.CL·

AIPatient Arena: EHR-grounded evaluation of large language models in end-to-end clinical consultation workflows

AIPatient Arena evaluates LLMs in multi-turn clinical consultation across 8 competence dimensions using EHR-grounded knowledge graphs. On 437 patients, models excel in questioning (4.43-4.99/5) and ethical conduct (4.38-4.93/5), but fail in diagnostic accuracy (2.63-3.55/5) and information coverage (2.08-3.02/5). Weaknesses include repetitive questioning, omitted medical history, inadequate uncertainty handling.

EvalsReasoningAI safety
SIG
82
HYP
15
arXiv cs.CL·

From Parasocial Scripts to Dyadic Persistence in Autonomous AI-Agent Communities

Analysis of 4,434 posts and 50,338 comments on Moltbook showing parasocial interaction cues (intimacy language, reciprocity bids, self-identification) persist in autonomous AI-agent communities. Results validated through keyword matching and LLM annotation reveal strong association between these signals and original poster re-engagement and sustained dyadic patterns.

AI AgentsMulti-agentPapers
SIG
72
HYP
15
arXiv cs.LG·

CheckMIABench: Firm Foundations For Membership Inference Attacks on Language Models

CheckMIABench introduces a benchmark for principled evaluation of membership inference attacks (MIAs) on language models. Leveraging intermediate checkpoints from open-source models (Pythia, OLMo, 70M–7B parameters), the authors construct reliable testbeds where training data before and after a fixed point share the same distribution. They evaluate six published attacks and release a modular library (pandora_llm).

PapersBenchmarksAI safety
SIG
78
HYP
15
arXiv cs.AI·

MapSatisfyBench: Benchmarking Satisfaction-Aware Map Agents through Behavior-Grounded Implicit Decision Factors

MapSatisfyBench is a benchmark for evaluating LLM agents integrated into map services. It measures their ability to identify and satisfy implicit user needs (unspoken decision factors) from real-world behavioral data. Experiments show current agents perform well on explicit task completion but struggle to proactively address implicit factors.

AI AgentsBenchmarksEvals
SIG
72
HYP
18
arXiv cs.AI·

FllumaOne: A Code-Native Multimodal CAD Dataset with Executable Programs and Kernel-Validated Feature Histories

FllumaOne is a multimodal CAD dataset of 100,000 models generated by executable Python programs in Flluma (OpenCASCADE-based CAD system). Each sample aligns the program with a feature tree, STEP representation, point cloud, and natural-language descriptions. A Qwen2.5-Coder-1.5B baseline achieves 99.98% Python syntax validity and 99.14% STEP-export validity.

Code generationBenchmarksVision
SIG
82
HYP
15
arXiv cs.CL·

Revisiting LLM Adaptation for 3D CT Report Generation: A Study of Scaling and Diagnostic Priors

Study of LLM adaptation for 3D CT report generation in medical imaging. RAD3D-Prefix, a lightweight diagnostic-prior framework, integrates image embeddings and multi-label classification logits. Across LLMs from 96.1M to 1.6B parameters, freezing the model and training only projection layers outperforms full fine-tuning, reducing clinical hallucination and overfitting.

Fine-tuningVision
SIG
72
HYP
15
arXiv cs.CL·

MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation

MODE-RAG is a multi-agent system driven by Variational Free Energy to reduce hallucinations in Multimodal Retrieval-Augmented Generation. It uses Monte Carlo Tree Search, logit perturbations, and specialized agents to route high-risk queries and perform post-hoc factual verification. Authors introduce ModeVent, a challenging subset of MultiVent dataset, to evaluate M-RAG robustness.

RAGMulti-agentVision
SIG
72
HYP
28
arXiv cs.AI·

MathVis-Fine: Aligning Visual Supervision with Necessity via Progressive Dependency-Guided Training for Multimodal Mathematical Reasoning

MathVis-Fine introduces a framework for fine-grained visual dependency modeling in mathematical reasoning. A new dataset augments visual annotations with visual dependency ratings. Two-stage progressive training balances answer correctness and visual grounding rewards according to each sample's intrinsic visual necessity, reducing reward bias.

ReasoningVisionBenchmarks
SIG
72
HYP
18
arXiv cs.LG·

Decision-Driven Geosteering Under Uncertainty: A Unified Framework for Sequential Decision Optimization

Sequential decision optimization framework for geosteering under geological uncertainty. Integrates particle filtering for probabilistic subsurface interpretation with value-based reinforcement learning. Compares three decision policies: Approximate Dynamic Programming, Deep Q-learning, and Dual DRL with dueling decomposition, validated on industrial simulator with realistic noise and drilling constraints.

Reinforcement learningReasoningEvals
SIG
72
HYP
15
arXiv cs.AI·

LongWebBench: Evaluating Structural and Functional Webpage Generation in Long-Horizon Settings

LongWebBench is a benchmark evaluating long-horizon webpage generation by vision-language models. It contains 490 real-world pages for structural evaluation and 507 goal-oriented interaction tasks over 129 pages. Experiments show structural fidelity degrades with webpage length, and visually plausible generations often fail to support multi-step executable interactions.

VisionBenchmarksAI Agents
SIG
75
HYP
20