Archives

June 2026

2731 articles

Reddit r/LocalLLaMA·

Open sourcing InfiniteKV: a KV cache that files old tokens as 104-byte searchable records in RAM or on disk instead of deleting them. Mistral-7B answered from token 76,747, 2.3x past its trained window. Colab demo

InfiniteKV compresses KV cache into 104-byte searchable records stored in RAM or disk instead of deleting old tokens. Mistral-7B correctly answers at token 76,747 (2.3× its 32,768 training window). One million tokens requires ~3 GB instead of 122 GB.

Open sourceInfrastructureLlama
SIG
82
HYP
25
arXiv cs.CL·

LEDGER: A Long-Context Benchmark of Corporate Annual Reports for Grounded Financial Retrieval and Extraction

LEDGER is a benchmark of 4,999 digitized corporate annual reports to evaluate LLM long-context capabilities in finance. The corpus includes 31 consolidated financial KPIs, 118,048 TREC-style retrieval questions, and extraction tasks on numerically dense documents. Case study: correlation between CEO rhetoric and post-publication market impact.

BenchmarksRAGReasoning
SIG
82
HYP
15
arXiv cs.CL·

Multi-Turn Reasoning When Context Arrives in Pieces: Scalable Sharding and Memory-Augmented RL

LLMs lose up to 65% accuracy when task-critical information arrives across conversation turns. Compact rolling memory replaces growing history attention. A sharding pipeline converts QA datasets into multi-turn fragmented-information episodes without manual annotation. Training on sharded GSM8K improves multi-turn accuracy and generalizes zero-shot to harder math and out-of-domain long-context QA.

ReasoningReinforcement learningMulti-agent
SIG
78
HYP
15
arXiv cs.CL·

PRISM: Prosody-Integrated Multi-Agent Reasoning Framework for Empathetic Spoken Dialogue

PRISM is a multi-agent framework for empathetic spoken dialogue that decouples speech perception, response generation, and speech synthesis. It introduces a prosody-to-language translation mechanism to stabilize LLM reasoning and integrates external knowledge tools. Results show improvements in empathy, prosodic appropriateness, and response quality across metrics.

Multi-agentVoiceAI Agents
SIG
72
HYP
28
arXiv cs.CL·

Shopping Reasoning Bench: An Expert-Authored Benchmark for Multi-Turn Conversational Shopping Assistants

Shopping Reasoning Bench: expert-authored benchmark of 525 missions (232 single-turn, 293 multi-turn) with 10,863 importance-weighted binary rubrics for evaluating conversational shopping assistants. Evaluation of 9 models (GPT, Claude, Gemini): pass rates 57–77%, performance degrades 4–18 points across conversation turns, 13–29 point gap between required and optional criteria.

BenchmarksGPTClaude
SIG
75
HYP
25
arXiv cs.AI·

MARS: Margin-Adversarial Risk-controlled Stopping for Parallel LLM Test-time Scaling

MARS is an adversarial stopping rule for parallel LLM test-time scaling. It probes partial traces at intermediate checkpoints to estimate which traces will change answers, enabling early stopping once the leading vote is safe. Across three reasoning models and three competition-math benchmarks, MARS saves 25-47% of self-consistency tokens while maintaining accuracy.

ReasoningEvalsBenchmarks
SIG
78
HYP
15
arXiv cs.AI·

HarnessBridge: Learnable Bidirectional Controller for LLM Agent Harness

HarnessBridge is a learnable agent-environment interface controller using bidirectional projection. The module distills raw observations into compact decision-relevant states and converts proposed actions into executable transitions. Trained on Terminal-Bench 2.0 and SWE-bench Verified, it matches specialized harnesses while reducing token usage and trajectory length.

AI AgentsReasoningCode generation
SIG
72
HYP
28
arXiv cs.AI·

Teach-and-Repeat: Accurately Extracting Operational Knowledge from Mobile Screen Demonstrations to Empower GUI Agents

Teach VLM extracts operational knowledge from mobile screen demonstrations by analyzing visual state transitions and generating natural-language instructions. The Teach-and-Repeat paradigm uses this knowledge to guide downstream GUI execution agents. Evaluation on Android World shows consistent Task Success Rate improvements.

AI AgentsVisionCode generation
SIG
72
HYP
28
arXiv cs.AI·

PRISMR: Overcoming Parse Collapse in Multimodal Listwise Ranking via Parameterized Representation Internalization

PRISMR addresses parse collapse in multimodal listwise ranking with LMMs. Problem: autoregressive decoders silently omit candidates and terminate early on long lists. Solution: lightweight hypernetwork generates item-specific LoRA weights synthesized into instance-specific adapter. New large-scale multimodal review-ranking benchmark introduced.

VisionReasoningFine-tuning
SIG
72
HYP
18
arXiv cs.AI·

Constructing Evaluation Datasets for Procedural Reasoning: Balancing Naturalness, Grounding, and Multi-Hop Coverage

Study on generating evaluation datasets for procedural reasoning. Three strategies compared: strict generation from TMK (Task-Method-Knowledge) models, transcript-first generation with post-hoc TMK filtering, and TMK-aware generation. Across 690 QA pairs and 23 instructional topics, strict TMK generation achieves 96.5% grounded questions and 92.6% usable items.

EvalsReasoningBenchmarks
SIG
72
HYP
15
arXiv cs.AI·

Multi-Modal Agents for Power Distribution Defect Detection: An Evaluation of Foundation Models

Multi-modal agent framework for power distribution defect detection using foundation models. Systematic evaluation of three capabilities: perception (equipment identification and defect description), reasoning (diagnosis and maintenance planning), tool usage (autonomous execution). Domain-specific evaluation dataset and comprehensive benchmark developed.

AI AgentsVisionReasoning
SIG
72
HYP
28
arXiv cs.AI·

TrajGenAgent: A Hierarchical LLM Agent for Human Mobility Trajectory Generation

TrajGenAgent is a hierarchical LLM-agent framework for realistic human mobility trajectory generation without model fine-tuning. An orchestrator LLM synthesizes activity chains via in-context learning, then a deterministic workflow grounds them using personalized POI retrieval, distance-aware location selection, and LLM-based duration estimation. Evaluation via anomaly-detection framework on benchmark datasets.

AI AgentsPrompt engineeringReasoning
SIG
72
HYP
18
arXiv cs.AI·

Pythagoras-Prover: Advancing Efficient Formal Proving via Augmented Lean Formalisation

Pythagoras-Prover is an open-source family of efficient Lean theorem provers (4B and 32B parameters, including a diffusion-based prototype). Via curriculum SFT and Augmented Lean Formalisation (ALF), the 4B model outperforms DeepSeek-Prover-V2-671B on MiniF2F-Test (86.1% vs 82.4%) with 167x fewer parameters. The 32B achieves 93.0% on MiniF2F-Test and solves 93/672 PutnamBench problems.

ReasoningCode generationBenchmarks
SIG
82
HYP
25
arXiv cs.AI·

Topical Phase Transitions in Artificial Intelligence Research: Large-Scale Evidence and an Early-Warning Signature for Emerging Topics

Analysis of 80,814 papers from 5 major AI conferences (2017-2025) reveals research topics advance through abrupt phase transitions, not gradually. LLMs dominant by 2025; diffusion models and vision-language models surged within 1-3 years. Early-warning signature flags reasoning, test-time compute, agentic AI, multimodal LLMs, RAG, and world models as topics to monitor 2026-2028.

BenchmarksPapersReasoning
SIG
78
HYP
25
arXiv cs.AI·

Arbor: Tree Search as a Cognition Layer for Autonomous Agents

Arbor is a multi-agent framework introducing tree search as a cognition layer for autonomous agents. Validated on full-stack LLM inference optimization, it pairs an Orchestrator agent with a Critic agent in a checks-and-balances architecture. Arbor achieves 193% throughput-latency Pareto improvement over vendor-optimized baselines, versus 33% for a single agent that crashes within hours.

AI AgentsMulti-agentReasoning
SIG
82
HYP
25
arXiv cs.AI·

Definitional alignment before capability alignment: a Design-Science framework for adjudicating claims about AGI

Paper introduces DAF-AGI, a governance framework to adjudicate competing AGI definitions. Analyzes five measurement families (performance, capability-ontology, psychometric, skill-acquisition, economic) and tests whether current generative systems constitute AGI. Only performance-based operationalization certifies this claim on 2024-2025 evidence.

ReasoningEvalsAlignment
SIG
72
HYP
15