A multi-agent system coordinates multiple autonomous AI agents working together to complete complex tasks. Example: AutoGen (Microsoft) lets developers orchestrate specialized agents that collaborate through message passing.
RTSGameBench is a benchmark to evaluate strategic reasoning in Vision-Language Models (VLMs) using real-time strategy games. Built on Beyond All Reason, it offers multi-scenario evaluations, diagnostic mini-games targeting specific competencies, and a self-evolving generation framework. Current state-of-the-art VLMs fail at multi-agent coordination and complex task scaling.
PhysAssistBench is an interactive medical assistance benchmark with 1,296 physician-validated turns built from real MIMIC-IV cases. It evaluates LLMs' ability to coordinate clinical knowledge, patient communication, and EHR system interaction within single dialogues. Experiments show current models remain unreliable in this setting.
Framework for customization and efficient deployment of LLM-based multi-agent systems in enterprise settings. Combines continual pretraining, supervised fine-tuning, and preference optimization to adapt compact models to specialized domains. Integrates speculative decoding and FP8 quantization to reduce latency and costs. Achieves 4.48x throughput speedup while maintaining performance.
Study of human-AI team collaboration in shared workspace using Collaborative Gym and DiscoveryBench. Adding collaborators improves performance only with coordination structure. Scaffolding combining shared memory and human-in-the-loop gates increases performance, especially in three-person teams, by clarifying responsibilities and routing expertise.
SAGE is a stochastic prompt optimization framework using multi-agent guided exploration. Compares three strategies: error-informed random search, genetic algorithm, and SAGE with diagnostic code execution. Deployed on mental-health chatbot: 8 cycles of noisy A/B tests compound into statistically robust next-day retention gain.
R2D-RL bridges RoboCup 2D Soccer Simulator (RCSS2D) to Python MARL workflows via shared-memory communication. The environment supports full-field and scenario-based training with discrete/hybrid action spaces, action masks, EPV-based reward shaping, and parallel execution. Includes 11-vs-11 full-field benchmarks and baseline results.
ByteDance releases UI-TARS-desktop, an open-source multimodal AI agent stack. The project connects cutting-edge AI models and agent infrastructure to automate UI-based tasks.
OpenMontage is an open-source, agentic video production system with 12 pipelines, 52 tools, and 500+ agent skills. Converts an AI coding assistant into a full video production studio.
ByteDance releases UI-TARS-desktop, an open-source multimodal AI agent stack connecting cutting-edge AI models and agent infrastructure. Platform for building agents capable of interacting with user interfaces.
Microsoft releases RD-Agent, an autonomous AI system to automate R&D processes in data science and ML. The agent drives experiments, data analysis, and model iterations without human intervention.
OpenMontage is an open-source, agentic video production system with 12 pipelines, 52 tools, and 500+ agent skills. Converts an AI coding assistant into a full video production studio.
Analysis of 4,434 posts and 50,338 comments on Moltbook showing parasocial interaction cues (intimacy language, reciprocity bids, self-identification) persist in autonomous AI-agent communities. Results validated through keyword matching and LLM annotation reveal strong association between these signals and original poster re-engagement and sustained dyadic patterns.
FinAcumen is a financial multimodal reasoning agent that accumulates experience from prior trajectories in persistent memory. The system improves a frozen 8B vision-language model across four financial benchmarks using selective experience activation and a deterministic tool environment for numerical computation and verification.
CEO-Bench, a multi-agent benchmark, evaluates LLMs' ability to make strategic resource reallocation decisions. Five frontier models tested on 13 scenarios show high structural validity but diverge on strategic calibration. Failure modes include single-advisor capture and historical amnesia.
Study on agent routing at scale: with 110 agents and 584 tools, F1 accuracy drops 16–23 percentage points on under-specified requests. Analysis decomposes degradation into retrieval gap and confusion gap (10pp oracle ceiling loss). Embedding-based shortlisting recovers +10–11pp F1 at full scale across models.
arXiv paper proposing architecture for distributed peer-to-peer autonomous agent networks. Authors identify three core mechanisms: semantic announcement propagation for collaborator discovery, verifiable identity and multi-topic reputation (MG-EigenTrust), and mechanism design for open task execution. Prototypes and simulations presented.
LLM-as-Environment-Engineer framework: the policy model analyzes failure trajectories and proposes modifications to the next-stage RL training environment configuration. MAPF-FrozenLake testbed with multi-dimensional configurations. Qwen3-4B outperforms GPT and Gemini on proposed benchmarks.
MODE-RAG is a multi-agent system driven by Variational Free Energy to reduce hallucinations in Multimodal Retrieval-Augmented Generation. It uses Monte Carlo Tree Search, logit perturbations, and specialized agents to route high-risk queries and perform post-hoc factual verification. Authors introduce ModeVent, a challenging subset of MultiVent dataset, to evaluate M-RAG robustness.
Fair token allocation system for decentralized agentic networks. Approach combines multi-modal representations, differentially private prototypes, and reward scheme robust to data heterogeneity. Simulations show improved fairness and QoS, with enhanced resistance to image reconstruction attacks.
VIBEMed is a multi-agent framework with self-evolution mechanism for clinical decision support. Three specialized agents (diagnostic, therapeutic, evolution manager) integrate patient session history and past outcomes to iteratively improve medical decisions. Results on oncology planning and complex cases.
The AI Scientist automates the entire research lifecycle: idea generation, coding, experiments, data analysis, manuscript writing, and peer review. An AI-generated manuscript passed the first round at a major ML conference workshop (70% acceptance rate). The system leverages foundation models within a complex agentic architecture.
DiSan, a privacy-preserving sanitization framework, factorizes text into two subspaces: one preserving task semantics and one containing stylistic signatures. On a distributed multi-agent RAG benchmark, DiSan reduces PII exposure by 20× while maintaining 83% answer faithfulness, and lowers Enron stylometric attribution by 73.2% (TF-IDF) and 70.6% (neural probe).
AgentViSS benchmark evaluates visual social intelligence of multimodal agents in social simulations. 240 scenarios, 585 roles, 2,340 instances test whether MLLMs use visual cues (expressions, posture, gaze) to guide interactions. Seven models evaluated show gap: expression and conflict handling near saturation, interaction regulation and visually grounded outcomes remain substantially harder.
TriAdReview proposes a triangular adversarial architecture with two reviewer models (engineering and security perspectives) to improve technical document generation. Across 75 experiments, the triple model achieves +10.1% over baseline (26.2 vs 23.8/50, p<0.05), with strong gains on security audit (+27.6%), code generation (+20.8%), architecture design (+15.6%), but -7.5% degradation on requirements analysis.
Edu-Theater is an LLM-powered multi-agent system for scalable learner behavior simulation. It uses a cohort-aware approach with targeted diagnostic queries instead of dense per-learner histories, reducing LLM calls and data requirements. Tested on two real-world datasets, it improves simulation accuracy and downstream applications like adaptive testing.
Theoretical paper introducing synthetic counteradaptation: a process where humans and AI systems co-evolve by adapting to each other's strategies. Authors analyze examples from Go, mixed-motive social interactions, and geopolitical simulations to demonstrate recursive, co-evolutionary dynamics in multi-agent environments.
Visual-Seeker is a multimodal deep search agent that enhances visual reasoning in MLLMs for complex scenarios. The approach uses an active visual reasoning data pipeline and 5K synthetic multimodal trajectories for training. The agent achieves SOTA performance across five multimodal search benchmarks, surpassing some proprietary models.
arXiv study on medical hallucinations in LLMs. "Trust but Verify" multi-agent system testing 3 model families (GPT-OSS, Llama-3, Falcon-3) on 103 clinical MCQs featuring banned pharmaceuticals. Five-agent architecture reduces Hallucination Error Rate by 53% and enforces appropriate refusal over dangerous recommendations.
YeasierAgent introduces an application-building paradigm based on symbiotic agents, narrative worlds, and scene-aware interaction. The system unifies automated generation, user-created worlds, and spatial multi-agent collaboration to enable cross-platform agent-native applications without reliance on fixed graphical layouts.
GTBP (Graph-based Target Back-Propagation) is a context adaptation framework for multi-LLM agentic systems. It back-propagates local targets through a directed acyclic graph workflow and updates prompts stage-wise. Theoretically convergent, outperforms baselines across 3 benchmarks.
VeriGeo generates controllable geometry problems via executable reasoning traces. An Author agent creates the problem and diagram per user constraints, a Solver agent produces the proof. A three-stage pipeline verifies numerical, analytical, and global consistency. Fine-tuning on 8.7k examples achieves best reported GeoQA performance and strong results on PGPS9K and MathVista-GPS.
HarnessX is a foundry for composable and adaptive AI agent harnesses. It uses AEGIS, a trace-driven multi-agent evolution engine, to optimize prompts, tools, and control flow. Across 5 benchmarks (ALFWorld, GAIA, WebShop, tau³-Bench, SWE-bench), HarnessX achieves +14.5% average gain (up to +44%), without model scaling.
Decentralised shielding method for multi-agent reinforcement learning ensuring global safety without centralised runtime control. Agents share a global LTL_safe specification and select local obligations whose conjunction implies the global specification, via a non-stationary multi-armed bandit. Evaluation across 6 environments and 15 algorithmic variants.
MedLatentDx is a latent multi-agent communication framework for cross-hospital rare-disease diagnosis. Hospital agents keep clinical records private and exchange compact KV latent blocks instead of raw text, complying with privacy regulations. Two deployment modes: KV distillation for same-backbone agents, cross-family latent alignment for different LLMs.
Multi-agent AI system for automated high school transcript processing. Four-agent architecture (pattern recognition, semantic analysis, vision intelligence, orchestration) achieves 96.7% accuracy on 40 real transcripts from 13 U.S. states, 45 seconds per document.
LobeHub organizes AI agents into 24/7 operations through hiring, scheduling, and reporting. Platform for managing autonomous agent teams.
BitBoard, YC P25 startup, launches an analytics workspace for AI agents. The platform enables monitoring, debugging, and optimizing multi-agent systems in production.
NVIDIA NeMo is an open-source framework for building generative AI models: LLMs, multimodal, ASR, and TTS. Designed for researchers and developers, it provides a scalable foundation for training and deployment.
SkillChain automates skill evolution for multimodal e-commerce AI assistants. The system manages three stages: Skill creation from task specs, routing optimization, and iterative refinement via dual-path LLM-Judge evaluation. Deployed at production scale, it improves structural compliance and content quality, confirmed by A/B testing on user engagement.
PRISM is a multi-agent framework for empathetic spoken dialogue that decouples speech perception, response generation, and speech synthesis. It introduces a prosody-to-language translation mechanism to stabilize LLM reasoning and integrates external knowledge tools. Results show improvements in empathy, prosodic appropriateness, and response quality across metrics.