Formal study of imperfect world model exploitation in RL. Authors define exploitation as divergence between policy preferences in the model versus true environment. They prove exploitation is essentially unavoidable on large policy sets and establish theoretical bridge with reward hacking.
Method to expand LLMs to new languages without costly alignment phase. Converts dense model to Mixture-of-Experts architecture with language-specific experts, then transfers alignment capabilities via post-training delta fusion. Improves performance on new languages while preserving original abilities.
LongAct is a benchmark for evaluating autonomous planning in long-horizon household tasks specified via free-form instructions. HoloMind, a VLM-driven agent with DAG-based hierarchical planner, Multimodal Spatial Memory, and Episodic Memory, achieves 59% goal completion and 16% full-task success with GPT-5 and Qwen3-VL models.
ResDreamer, a hierarchical world model, reconstructs residuals at each layer to progressively abstract visual dynamics in a self-supervised manner. Without domain-specific knowledge, it achieves state-of-the-art sample and parameter efficiency for RL in 3D adversarial environments. Code released.
AutoLLMResearch introduces an agentic framework to automate configuration of expensive LLM experiments. The system learns from low-fidelity experiments to extrapolate toward promising high-fidelity configurations. LLMConfig-Gym provides a multi-fidelity environment with >1M GPU hours of verified experiment outcomes.
D²Evo is an RL framework to enhance LLM reasoning through self-evolution. The method generates medium-difficulty training samples by mining anchors matched to model capability, then jointly optimizes a Questioner and Solver. Results: outperforms existing methods on mathematical reasoning benchmarks with <2K real examples.
Longitudinal study of 235M posts from 4M Bluesky users showing algorithmic feed exposure (News, Science, Blacksky) measurably shapes user language: semantic alignment, register formalization, psycholinguistic restructuring. Reposting is the strongest predictor of linguistic convergence across feeds.
Comparative study on surgical AI: multi-billion parameter Vision Language Models fail at neurosurgical tool detection despite extensive training. Scaling experiments show diminishing improvements. Obstacles persist across architectures, suggesting data and compute alone are insufficient.
UniversalRAG extends retrieval-augmented generation (RAG) to heterogeneous multi-modal corpora (text, images, videos) with variable granularities. The framework proposes modality-aware routing to avoid intra-modal bias and dynamically retrieve from the appropriate corpus. Validated on 10 multi-modal benchmarks.
New Interactive Benchmarks evaluation paradigm assesses model reasoning through budgeted multi-turn interaction. Two settings: Interactive Proofs (logic, UI2Html, mathematics with objective feedback) and Interactive Games (strategic reasoning). Reveals substantial gaps in current interactive capabilities.
A2RBench is an automated pipeline for generating formally verifiable abstract reasoning benchmarks. Using programmatic verification (cycle consistency), it eliminates hallucinations and scales task variations. Evaluations show current LLMs score 39.8% vs 68.5% for humans, and struggle with complex 3D tasks.
A framework uses language models to identify 'alien' research directions—coherent with existing literature but unlikely under current researcher distribution. On 16,068 AI/NLP papers, the method explores 3.5-7× broader conceptual space than baselines while maintaining scientific coherence.
Systematic study of reasoning faithfulness in Vision-Language-Action (VLA) driving models. Analysis of 300 Alpamayo-R1-10B inferences across 100 PhysicalAI-AV scenarios reveals: reasoning fidelity 42.5%, 94 missed pedestrians, 97.7% trajectory fragility under visual perturbations, 48.3% reasoning-action consistency. Proposes four-component safety architecture.
LLMs exhibit 'conversational inertia' in multi-turn agent scenarios: they over-imitate their previous responses instead of exploring. Authors identify this bias through attention analysis and propose Context Preference Learning to favor low-inertia responses. Validated across 8 agent environments.
arXiv paper proposing a formal statistical framework to combine LLM and human evaluations. Uses a doubly robust estimator (missing data approach) to determine optimal sample sizes of human ratings needed for benchmark validation, based on LLM judgment predictability.
MirrorBench is a benchmarking framework to evaluate user-proxy agents in conversational systems. It combines 6 metrics (MATTR, Yule's K, HD-D, GTEval, Pairwise Indistinguishability, Rubric-and-Reason) to measure realism of LLM-generated user utterances across 4 public datasets. Open-source code released.
AgroCoT is a VQA benchmark with 4,759 Chain-of-Thought samples designed to evaluate reasoning capabilities of Vision-Language Models in agriculture. Evaluation of 30 VLMs (proprietary and open-source) reveals significant gaps in zero-shot reasoning, highlighting the importance of CoT for precision farming applications.
Vercel integrates Claude Managed Agents with Vercel Sandbox. Agents run in isolated Firecracker microVMs with access to private APIs and customer data. Credential brokering and deny-by-default egress secure execution.
Machine Learning Reproducibility Challenge 2026 opens submissions as an official track at NeurIPS 2026 in Sydney, December. Accepted papers via TMLR are eligible for conference presentation.
Anthropic acquires Stainless, a startup focused on SDK generation and developer tools. The acquisition strengthens Anthropic's infrastructure and tooling capabilities for developers using Claude.
Hugging Face launches a public leaderboard to evaluate open-source AI agents. The platform ranks models by their ability to complete complex tasks, with reproducible benchmarks and transparent results.
Hugging Face revives PapersWithCode using AI agents to automatically parse papers and generate leaderboards. Site features trending papers, domain categorization, eval results (Qwen 3.5, RF-DETR, DINOv3), leaderboards (MMTEB, COCO), citation counts, linked GitHub repos, and external paper support (DeepSeek v4). Live at paperswithcode.co.
A paid program (Algoverse AI Research) marketed to high school students produces mass NeurIPS 2025 submissions (289 claimed acceptances) with obvious errors: duplicate results, abstracts contradicting findings, AI-generated citations, unreviewed datasets. Kevin Zhu, program-affiliated, lists 158 publications and 468 coauthors on OpenReview.
Cerebras announces a $60B IPO. The AI chip specialist accelerates commercial expansion after years of technology development.
Release of datasette-agent 0.1a2 with permission system. Background agent tools now require the new `datasette-agent-background` permission. Tool availability can be attached to required permissions.
IBM and Hugging Face release Granite Embedding Multilingual R2, an open-source embedding model under Apache 2.0 license. The model supports 32K token context and delivers best-in-class retrieval quality for sub-100M parameter models across multiple languages.
Vercel introduces Protected Source Maps, restricting access to production .map files via Vercel Authentication. Authorized teams can fetch them for debugging minified code; others receive a 404. Enabled by default for new projects.
Vercel introduces Trusted Sources, a security mechanism using short-lived OIDC tokens to authorize protected deployments without sharing long-lived secrets. Vercel projects and external services (GitHub Actions, etc.) can be authorized via customizable from/to rules per environment.
llm 0.32a2 adds support for OpenAI's `/v1/responses` endpoint for reasoning-capable models (GPT-5 class). Displays summarized reasoning tokens in distinct color. Use `-R` or `--hide-reasoning` flags to hide them.
Vercel releases production index from 7 months of AI Gateway traffic (200K+ teams). April 2026 spend: Anthropic 61%, Google 21%, OpenAI 12%; token volume: Google 38%, Anthropic 26%, OpenAI 13%, xAI 10%. Premium models (Claude Opus) dominate high-stakes workloads, cheap fast models (Gemini Flash) drive volume.
Vercel Flags now supports progressive rollouts, enabling feature deployment to a growing percentage of users on a predefined schedule. Unlike fixed weighted splits, each stage has a target percentage and duration, catching regressions on a small user slice before full rollout. Available via dashboard and CLI.
The New York Times corrected an article after discovering a quote attributed to Pierre Poilievre was an AI-generated summary presented as a direct quotation, not from an actual speech. The publication replaced the false quote with an accurate statement from Poilievre's April 2026 speech.
Vercel Chat SDK adds Messenger adapter enabling multi-platform bots across Slack, Discord, GitHub, Teams, Telegram. Supports messages, reactions, attachments, postback buttons. Limitations: no message history, editing, or deletion.
Vercel AI SDK now supports cross-platform conversation history via transcripts and identity options. Messages persist across all adapters, allowing users to maintain their history regardless of messaging channel. Four methods available: append, list, count, delete.
Anthropic and SpaceX sign a $5B/year deal for 300MW of power for Colossus I, Anthropic's supercomputer. Annualized ARR growth reaches 8000%.
General Intelligence builds Cofounder, a platform of AI agents to run an entire company (engineering, marketing, finance, support). The 8-person team (5 engineers) migrated to Vercel for total programmatic control: 4,000+ preview branches, 70+ commits per engineer per day, 90% of SRE work automated through their own agents.
OpenAI rebuilt its WebRTC stack to enable real-time Voice AI with low latency, global scale, and seamless conversational turn-taking capabilities.
Vercel launches native Deployment Checks, enabling lint and typecheck to run in parallel with builds on every deployment. Checks can be marked as required to block production deployments. Vercel Agent automatically suggests fixes when checks fail.
NVIDIA releases Nemotron 3 Nano Omni, a multimodal model handling documents, audio and video with extended context. Optimized for agents, it unifies vision, voice and text processing in a single architecture.
OpenAI achieves FedRAMP Moderate authorization for ChatGPT Enterprise and OpenAI API, enabling U.S. federal agencies to deploy AI services with government-mandated security compliance.