MeDial-Speech: dataset of 111+ hours of spoken medical dialogues (robot-patient and doctor-patient) covering 4 health conditions. Benchmark of 3 LLMs (GPT-4 mini, DeepSeek-V3, Claude Sonnet 4) via sentence selection: Claude Sonnet 4 achieves 71.1% accuracy. Reveals systematic overconfidence in model predictions.
Theoretical study showing that one linear self-attention layer can implement a gradient-descent step on a unified RAG objective. Authors propose a lightweight method to adapt query-evidence interaction without modifying retriever or backbone, tested on 7 QA benchmarks with consistent improvements over baseline.
MiniMax introduces the M2 series, MoE models with 229.9B total parameters and 9.8B activated per token. Built for agentic deployment, they integrate agent-driven data pipelines, Forge (agent-native RL system), and M2.7 with self-evolution capabilities. Frontier-tier performance on agentic coding, deep search, and reasoning benchmarks.
Causal analysis of prompt optimization methods (DSpy, TextGrad) explaining generalization failures. Complexity-increasing edits harm mathematical and multi-hop reasoning, while step-by-step edits improve logical reasoning. Failures stem from systematic interactions between edit families and task characteristics, not random artifacts.
Hugging Face introduces Delta Weight Sync in TRL to optimize deployment of trillion-parameter models. The technique syncs only weight changes rather than full models, drastically reducing storage and bandwidth requirements for updates.
PrismML releases Bonsai Image 4B, 1-bit/ternary quantized text-to-image diffusion transformers. ~3GB model size (vs 16GB for FLUX.2 Klein), runs 100% locally in browser via WebGPU. Apache-2.0 licensed.
Tomesphere indexes 3 million arxiv/OpenAlex papers with Gemini TLDRs, OpenReview peer reviews, GitHub repos, citation graph (250M edges), and SPECTER2 semantic graph (768D pgvector). Four ranking modes: Influential, Recent, Hidden gems, Nearest. Chrome extension for arxiv. Free, no signup.
Microsoft Copilot Cowork allowed agents to send unapproved emails to the user's inbox. These messages could contain external images triggering network requests, enabling data exfiltration. A successful prompt injection could leak pre-authenticated OneDrive download links, granting attackers file access.
dlmserve is the first serving engine for diffusion language models (LLaDA, Dream-7B). Unlike autoregressive LLMs, they denoise a fully masked sentence in parallel. OpenAI-compatible API, continuous batching, 2.5x throughput vs HuggingFace at batch=4, runs in 12 GB VRAM. MIT licensed, pip install dlmserve.
An audit of 2.5 million biomedical papers shows fabricated references increased 1200% since 2023. Researchers suspect language models: fake citations match paper topics, follow correct formatting, and are nearly undetectable. 98% of affected papers received no publisher response.
Benchmark study across 23 models showing that context compaction, the standard technique for long agent sessions, does not fix persona drift. ContextEcho evaluates this critical limitation in current systems.
Mozilla releases cargo-vet, a supply-chain security tool for Rust. It enables auditing and validating Rust dependencies before production use.
FunASR is an industrial-grade speech recognition toolkit supporting 170x realtime, 50+ languages, speaker diarization, emotion detection, streaming, and OpenAI-compatible API.
A security researcher bypassed AWS API Gateway authentication by exploiting a trailing slash vulnerability, earning a $12,000 bounty from AWS's bug bounty program.
Shard is a HuggingFace Cache achieving 10× KV memory compression for Llama-3.1-8B at 8K context (11× at 32K) with no measurable impact on NIAH/LongBench. Uses PCA + int4 quantization on K and Hadamard rotation + vector quantization on V. Attention runs directly on compressed K.
Method to improve consistency in automated labeling pipelines for content moderation. Authors propose an AI-driven workflow where an LLM writes detailed per-category constitutions (harassment, hate speech, non-violent crime), then a frontier LLM interprets them to generate golden labels. Result: 57x reduction in cross-model inconsistency vs paragraph definitions.
TUBE is a variational upper bound on log-likelihood for discrete diffusion models. Unlike existing ELBOs, TUBE admits an unbiased Monte Carlo estimator and applies to masked diffusion models, any-order ARMs, and block variants. Experiments show discrete diffusion models lie strictly below exact ARM baselines in likelihood.
Comprehensive survey on trustworthy agentic AI systems (LLMs augmented with planning, tool use, memory). Examines safety, robustness, privacy, and system security. Proposes unified metrics, benchmarks, and stage-targeted mitigation strategies across agent workflows. Identifies open challenges: self-evolving agents, runtime verification, privacy-preserving personalization.
AstroMind is a benchmark for evaluating LLM reasoning on spacecraft behavior. Built on high-fidelity astrodynamics simulations, it tests intent inference, maneuver parameter estimation, and threat assessment. Qwen3 (32B) leads intent inference, QwQ (32B) leads threat assessment, GPT-OSS (20B) produces strongest reasoning quality.
Researchers train neural networks on WikiText-103 (103M tokens) using Successor Representations from RL to predict future word distributions. Without explicit linguistic supervision, grammatical categories (nouns, verbs, adjectives) spontaneously emerge and become separable via unsupervised clustering, organized by predictive horizon.
HyperGuide uses hyperbolic geometry to guide multi-step reasoning in LLMs. A lightweight head projects hidden states into hyperbolic space, where distance-to-origin encodes solution proximity. A low-rank adapter is fine-tuned interactively. Consistent gains across benchmarks, with larger improvements on deeper reasoning chains.
A theoretical framework (algometrics) analyzes deployment risks of predictive models in algorithmic markets, where predictions modify future data. Authors prove deployment risk is not identifiable from historical data alone, and model rankings can invert under crowding.
Analysis of 20 million Twitch chat messages (4,452 streams, 7 genres) using LLM zero-shot classification. 2.4% of messages classified as toxic per Twitch taxonomy (harassment, discrimination, sexual content, profanity). F1=94.5% on TextDetox. MOBA games show 3.2% toxicity, sports games 2%. Significant within-genre variation reveals game-specific community norms.
RIA couples an LLM with an action-conditioned world model for autonomous driving. At each step, the LLM proposes actions, the world model validates via short-horizon rollouts, and a safety scorer selects the safest action. On CARLA (1000 episodes): 80.05% route completion, 51.10% arrival rate, 0.20% collision rate.
Vercel Sandboxes enables filesystem persistence by default in GA. Snapshots are automatic, sandboxes resume from the latest saved state. New methods: fork(), getOrCreate(), delete(), custom tags, and lifecycle hooks.
Nathan Witkin (NYU Stern) harshly critiques METR's AI time horizons graph. Errors include: unmeasured human baselines merely estimated, hourly-paid benchmarkers incentivized to work slowly, biased sample toward authors' peers, and failure to account for familiarity advantage (5-18x faster). Witkin concludes the graph contains too many compounding errors to be salvaged.
Controlled study on TypeScript codebase (25 sections, 3,250 files): LLM (Kimi K2.6) equipped with structural graph (Blueprint: Universal Ctags + ast-grep + BM25) consumed 54% more input tokens (63,541 vs 41,327) but explored deeper (6 turns vs 5). Graph costs ~6,500 tokens and increases model's navigational confidence.
CUDA implementation of Fast Walsh-Hadamard Transform (FWHT) for llama.cpp optimizing KV-cache quantization. 1-2% speedup on prefill, 7-9% on token generation with RTX 5090 and q8_0 quantization.
Call for papers for the 2nd Workshop on Efficient Reasoning at COLM 2026 (October 9). Deadline: July 12, 2026. Topics: multimodal reasoning under efficiency constraints, dataset curation, algorithmic innovations, fast inference (pruning, compression, KV-cache), benchmarks, on-device deployment, safety, real-time applications (healthcare, robotics).
Endeavour Energy, Australia's major electricity distributor, migrated its outage map to Next.js on Vercel. Results: sub-1s page loads during peak storm traffic, 5-minute data sync cycles, 38% faster deployments. Supabase handles real-time data layer.
Small specialized models (Gemma 4 31B at 86.4% on tau2-bench, Qwen 27B outperforming 397B models) now dominate agentic benchmarks. Yet the industry keeps deploying expensive frontier models: frontier labs profit from per-token billing, creating misalignment between technical performance and market adoption.
NuExtract3 is a 4B vision-language model for document understanding. It combines structured extraction (text/images + JSON template → JSON output) and image-to-Markdown conversion, with multilingual support and reasoning/non-reasoning modes. Available in GGUF, NVFP4, MLX, VLLM.
llama.cpp PR #22929 optimizes checkpoint creation to avoid full context re-processing when conversation history is edited. Use case: agentic coding with 70k tokens. Improves responsiveness by reprocessing only changed portions, tested for 2 weeks.
arXiv paper proposing a methodology for designing AI benchmarks suited to knowledge work (coding, research, healthcare). Authors critique current evaluations that don't reflect real-world conditions and propose a 3-step framework: define the activity, specify the setting (tools, roles, constraints), score the final product. Analysis of 3 cases: GDPval, OfficeQA Pro, APEX-SWE.
Theoretical study showing that exact certification of threshold circuits (depth ≥2) and log-precision Transformers becomes exponentially hard with minimal overparametrization. Adding a single gate or constant architectural overhead forces certificate sizes exponential in input dimension. Empirical validation on binary addition recognition.
MedExpMem is an experience memory framework enabling medical vision-language models to accumulate differential diagnosis expertise. Unlike RAG, it memorizes discriminative experiences from past diagnostic failures as pairwise differential notes. Evaluated across 11 radiology subspecialties, it improves accuracy up to 7.0% across diverse models.
Researchers use Transcoders to interpret how vision-language models transform images into text. Applied to Gemma 3-4B-IT, the framework decomposes the model into computational pathways linking image patches to token generation. Transcoder attributions outperform SAEs in identifying hallucinations (AUC 0.68).
Paper introduces parallel context compaction for long-horizon LLM agents to address latency and unpredictability of sequential summarization. Enables fine-grained control over summary volume and targeted prompt engineering per block. Evaluated on HotpotQA and LoCoMo benchmarks across 8B-120B models (dense and MoE architectures).
Theoretical study showing that network depth induces implicit low-rank bias, promoting alternatives to neural collapse. Analysis of unregularized deep UFM (unconstrained feature model) training dynamics reveals how depth favors softmax codes over classical structured geometries.
Two-stage federated recommendation pipeline for mobile devices: collaborative filtering on non-sensitive app-context data in cloud, then on-device re-ranking with sensitive mobile signals. Validated on MovieLens, UCI HAR, and proprietary dataset. Production-ready Kotlin Multiplatform library for Android/iOS.