2731 articles
ML study on rice yield forecasting in data-constrained Sierra Leone. XGBoost + satellite climate data (CHIRPS, NASA POWER) reduces error by 34% (RMSE 284 vs 428 kg/ha). May-June rainfall is dominant predictor. Open-source pipeline provided.
Researchers demonstrate that structured noise in artificial neural network activations improves robustness against adversarial attacks and naturalistic image modifications. This approach is inspired by neural variability observed in biological cortex and requires only local information.
OdysSim presents the largest systematic investigation of behavioral foundation models for human behavior simulation. Researchers propose SOUL, a taxonomy of 5 axes (CONV, SS, COG, ROLE, EVAL) unifying 62 datasets and 23 benchmark tasks. The open 8B OSim model ranks first/tied-first on 8/23 tasks, outperforming frontier models, with 93.2% reaction alignment vs 93.5% for real users.
Dose-AIPTB proposes an attention-based method to estimate the probability that a treatment benefits an individual patient under varying doses. The framework recasts the problem as binary classification of the individual treatment effect sign, using pairwise comparisons and attention-based aggregation. Code available on GitHub.
SuperThoughts compresses consecutive CoT token pairs into single latent representations and decodes two tokens per step via a lightweight Multi-Token Prediction module. Tested on Qwen2.5-Math (1.5B, 7B, 14B), the approach reduces CoT length by 20-30% while maintaining accuracy (1-2 point degradation on MATH500, AMC, OlympiadBench, GPQA-Diamond).
arXiv study on medical hallucinations in LLMs. "Trust but Verify" multi-agent system testing 3 model families (GPT-OSS, Llama-3, Falcon-3) on 103 clinical MCQs featuring banned pharmaceuticals. Five-agent architecture reduces Hallucination Error Rate by 53% and enforces appropriate refusal over dangerous recommendations.
Study across 9 models and 972,000 responses shows LLMs comply with harmful nudges on moral judgments (A=1.04) at nearly identical rates to beneficial ones, unlike factual questions (A=1.58). Chain-of-thought amplifies bidirectional compliance; identity-based prompting suppresses both equally.
D2H-AD is an anomaly detection framework based on Hyperdimensional Computing (HDC). It combines density-aware encoding and distance-based similarity, outperforming five baselines (HDAD, ODHD, One-Class SVM, Isolation Forest, Autoencoders) across five datasets. Hyperdimensional encoding alone achieves +5.4% ROC-AUC improvement. Lightweight, interpretable, computationally efficient: suited for TinyML and edge AI.
DiPOD, a diffusion policy optimization method, addresses RL post-training instability by identifying double-drift phenomenon (ELBO diverging from true log-likelihood). The approach interleaves self-distillation with policy-improving gradient updates, stabilizing training on language models and continuous-control tasks.
TopVAE, a topology-optimized VAE, reduces dark areas in latent space by internalizing structural and chemical constraints during training. Paired with a standard DiT, it achieves 77% lower FCD-3D on QM9 and 52% lower on GEOM-Drugs, generating more stable and chemically valid molecules.
VISTA proposes a GRPO-based fine-tuning method for GUI grounding. It generates multiple views of the same screen (crops preserving target elements) to create more robust comparison groups. On ScreenSpot-Pro, it improves Qwen3-VL 4B/8B/30B from 55.5/52.7/53.7 to 63.4/65.8/67.0.
Every Eval Ever introduces a unified schema and community repository to standardize AI evaluation results. The system ingests 22,235 models and 2,273 benchmarks through a single JSON format, with automatic converters from popular harnesses and leaderboards. Solves fragmentation of results scattered across incompatible formats.
Temporal planning framework for dynamic route optimization in heterogeneous multi-gauge railway networks. Formulates operations as PDDL 2.1 problem, models gauge compatibility constraints and disruption scenarios. Evaluated on 200 benchmark instances (up to 1,000 track points, 120 trains).
CacheRL trains small agent models (Qwen3-4B-Thinking) achieving 92% accuracy on multi-step tool-calling tasks with 100× less compute than GPT-5 (94%). Three innovations: hybrid thinking trajectory pipeline with LLM-generated reasoning, three-tier fuzzy cache eliminating live execution costs, cache-tier-aware rewards. SFT + GRPO improve validation reward from 0.43 to 0.78.
Gemma 4 models exhibit repetition loops on long enumerations (up to 95% failure rate). Per-neuron ablation identifies a few MLP neurons responsible: suppressing them via weight edits removes simple loops but not 'doom loops' (infinite self-correction), limited by knowledge gaps rather than removable circuits.
Zalando deploys high-frequency algorithmic pricing system for 5M+ articles during sales campaigns. Forecast-then-optimize architecture combining gradient boosting and multi-objective optimization. A/B tests across 12 markets (2023-2024): +6% profit, decision time reduced from hours to minutes.
Study of 1800+ Linguistics Olympiad Problems (LOPs) as a corpus for linguistic research. LOPs are self-contained puzzles requiring deduction of language rules. The paper evaluates their potential for academic linguistics and language models, proposing a theoretical framework for their integration.
PostDeg demonstrates that LayerNorm placement matters more than parameterization in GNNs. An inverse-degree scalar positioned post-LayerNorm preserves topology signals (degree, centrality) required by node-selection policies. Gains of +3.5% to +5.6% on influence maximization, network dismantling, and maximum independent set.
HarnessX is a foundry for composable and adaptive AI agent harnesses. It uses AEGIS, a trace-driven multi-agent evolution engine, to optimize prompts, tools, and control flow. Across 5 benchmarks (ALFWorld, GAIA, WebShop, tau³-Bench, SWE-bench), HarnessX achieves +14.5% average gain (up to +44%), without model scaling.
SkillAudit is a framework for evolving LLM agent skills without ground-truth feedback. Via paired trajectory auditing, the system executes the same task with and without the candidate skill, then uses Process-Aligned Contrastive Evaluation to isolate behavioral changes. Across 89 tasks, SkillAudit achieves 73.9% average task reward vs 56.7% for static expert skill.
GPU-based workflow for building physics emulators of hypersonic flows. Integrates JAX-Fluids (differentiable high-fidelity solver) for data generation and refinement of neural emulators with uncertainty quantification. Residual-based refinement improves physical consistency and enables training with limited parameters.
RicciBind, a geometric representation framework, predicts protein-ligand binding affinity by combining Ricci curvature to capture local organization and optimal transport for cross-domain alignment. Demonstrates superior performance on PLA benchmarks and virtual screening tasks.
Comparison of two intervention methods on safety refusals in chat models: Difference-in-Means (DiM) vs Iterative Nullspace Projection (INLP). On 5 open-weight models, INLP counterfactual flipping matches DiM for refusal suppression, while nullspace projection is consistently weaker. The two approaches operate differently in activation space.
Thesis on Bayesian principles applied to deep neural networks. Introduces DVIP (Deep Variational Implicit Process) for scalable Bayesian inference, and two post-hoc methods (VaLLA, FMGP) to calibrate uncertainty on pretrained networks. Develops unified theoretical framework connecting diversity, smoothness, and stochasticity via PAC-Bayesian and large-deviation theory.
A case study on semi-autonomous formalization of Grothendieck's vanishing theorem shows LLMs close proof gaps but produce non-reusable formalizations. After expert review, agents adapt well to local feedback but fail at designing sound definitions and APIs.
MoDiCoL is a modular continual learning dataset for evaluating ASR robustness under real-world distribution shifts (accents, noise, recording conditions, speech impairments). Authors propose a real-world-inspired curriculum and evaluate three continual learning strategies to analyze how robustness develops, transfers, and is forgotten.
New AI task: extracting applicability conditions for therapeutic drug-disease relations from biomedical literature. First manually annotated dataset with 1,119 drug-disease pairs. Proposed method enhances LoRA to model drug-disease relations, outperforming baselines.
Dialogue SWE-Bench is an automatic benchmark for evaluating coding agents through user dialogue. Authors introduce a persona-grounded user simulator and a schema-guided agent improving baselines by 3-14%. Key finding: better coding models don't necessarily translate to better dialogue capabilities.
Multi-agent AI system for automated high school transcript processing. Four-agent architecture (pattern recognition, semantic analysis, vision intelligence, orchestration) achieves 96.7% accuracy on 40 real transcripts from 13 U.S. states, 45 seconds per document.
Hybrid classical-quantum VAE for topic modeling. Parameterized quantum circuit (10 qubits) embedded in encoder, classical topic-word decoder. On AgNews: coherence score Cv=0.71, NPMI=0.20, outperforms state-of-the-art neural topic models.
MA-ProofBench is the first formal theorem-proving benchmark dedicated to Mathematical Analysis with 200 formalized theorems across two difficulty levels (undergraduate and Ph.D.). GPT-5.5 achieves only 16% Pass@8 on Level I and 5% on Level II, exposing major gaps in LLMs' advanced formal reasoning capabilities.
New method to enforce inequality constraints (monotonicity, convexity) in neural networks using neural slack variables. Couples primary network with jointly learned auxiliary network, converting constraint enforcement into regression problem. Achieves zero measured violations on monotonicity/convexity test cases, outperforming penalty and primal-dual baselines.
Study of internal representations in text-based LLMs and an ASR model examining whether V+up phrasal verbs develop distinct representations as a function of frequency and predictability. All models show evidence of holistic storage driven by these factors, supporting usage-based theories of language.
COMET combines a frozen unsupervised object-centric encoder with a transformer-based world model to perform Monte Carlo Tree Search in slot-structured latent space. A novel action-slot fusion mechanism binds actions to objects. Evaluated on 8 tasks (Object-Centric Visual RL, ManiSkill, Robosuite, VizDoom), COMET outperforms object-centric and monolithic baselines in early training stages.
VeriGeo generates controllable geometry problems via executable reasoning traces. An Author agent creates the problem and diagram per user constraints, a Solver agent produces the proof. A three-stage pipeline verifies numerical, analytical, and global consistency. Fine-tuning on 8.7k examples achieves best reported GeoQA performance and strong results on PGPS9K and MathVista-GPS.
LoSoNA is a benchmark measuring LLM ability to recognize and adapt to local social norms in group chats. Eight frontier and open-weight models tested under four prompting conditions: Gemini 3.1 Pro reaches 84.2%, Claude Fable 5 81.6%. Explicit norm-aware prompting helps unevenly.
Judge-LS evaluates whether LLMs used as automatic judges exhibit language bias. On 419 LLMBar benchmark items transformed into English, Chinese, and mixed-language variants, models show 10.7–14.4% preference flips across languages, with highest accuracy in English. Translation-equivalent probes reveal no systematic English preference, though most are judged as ties.
Formalized study of communication policies for autonomous LLM agents. Comparison of text-based vs UI-based strategies across multiple environments and models. Proposes Communication Policy Evolution (CPE), a self-evolution framework refining policies through rollout and prompt-level evolution, without model modification.
Persuasion Index (PI) is a taxonomy of 15 dimensions grounded in persuasion theories from psychology and communication. Implementation with 55 sub-features built from lexicons and rule-based detectors. Evaluation on 4 public datasets shows PI provides a shared feature space for interpreting rhetorical patterns. Lightweight linear models with interpretability. Open-source package and web interface released.
GitOfThoughts stores LLM agent reasoning as a git repository: each thought is a commit, scores are notes, outcomes are tags. Empirical study across 5 memory substrates (none, markdown, vector, graph, git): memory improves accuracy only when retrieved cases are near-duplicates of current problems (similarity >0.8). Main lever remains test-time sampling.
HOTE (Hybrid Open-Ended Tri-Evolution) is a hybrid reinforcement learning framework for autonomous evolution of AI agents on open-ended research tasks. An 8B model trained via HOTE outperforms static 8-32B models and state-of-the-art deep research methods on three long-form research benchmarks.
PauseRec introduces an implicit reasoning paradigm for LLM-based generative recommendation systems. The approach bypasses explicit reasoning pipeline limitations by avoiding reasoning trace acquisition, improving performance by up to 6.22%, reducing GPU training costs by 65%, and accelerating inference by 71.3%.
UP-NRPA, a user portrait-based framework, dynamically adapts dialogue strategies with LLMs without offline reinforcement learning. On collaborative and non-collaborative benchmarks, the system achieves 100% success rate across multiple tasks and increases sale-to-list ratio by 56.41% in negotiation.
AMD introduces a mini PC capable of running large AI models locally without cloud dependency or subscriptions. The device provides an alternative to traditional cloud services for AI inference.
Command A Plus and North Mini Code support added to llama.cpp. User converted and quantized Command A Plus to GGUFs due to lack of up-to-date versions.
Ironsmith, an open-source project, generates personalized macOS apps from prompts. Works with small models (Gemma 4 E4B) on 8GB MacBook Air. Uses custom agentic loop with deterministic syntax error repair. Compatible with Ollama, OpenAI API, Claude, Gemini.
User reports long coding-agent sessions suffer from "context rot": accumulation of failed debugging attempts, stale assumptions, and noise that degrades model reasoning. Proposes separating durable memory from active context rather than simply increasing context size.
Vercel increases Blob store limit for Hobby users from 5 to 100 stores. Storage, operations, and transfer limits remain unchanged.
Arvind Narayanan and Sayash Kappor reject the narrative of mass software engineer replacement by AI. Key data: New York recorded 160+ WARN Act filings in 2025—none checked the AI box. Automation hits three real bottlenecks: specifying what to build, verifying quality, and managing human dependencies.
Gemma 12B running on Google Pixel 10 Pro via Termux and llama.cpp (v9639) consumes under 10W. Performance: 6.5 tokens/s prompt, 1.3 tokens/s generation with 32k context and Q3_K_XL quantization.
Deep mathematical breakdown of GPTQ: 4-bit quantization preserves perplexity by treating weights as correlated. Author derives the update rule using Lagrange multipliers, explains 1% Hessian dampening, Cholesky decomposition over raw inverse, and C-contiguous memory optimization.
EAGLE support has been merged into llama.cpp. EAGLE is an inference acceleration technique for language models that reduces latency by predicting multiple tokens in parallel.
Jqwik, a Java testing library, rejected contributions generated by AI. The maintainer published a policy banning AI-generated PRs, sparking debate over code quality and attribution.
Independent researcher shows coherent context can shift LLMs into different internal regimes before final output, bypassing current safety filters (RLHF, output classifiers) while maintaining normal behavior. Work on Gemma-3-12B-IT analyzing hidden states and residual stream trajectories.
Benchmark of 4 models ≤120B on deep context (up to 400k tokens). Nemotron Super 120B outperforms GPT-OSS 120B and Qwen 3.5 122B in prompt processing (PP) speed from 16-32k tokens onward. Nemotron maintains >100 TPS PP up to 400k context, but token generation (TG) remains slow (10-20 TPS).
An article arguing that AI is fundamentally code and cannot be made smarter through prompting alone. Challenges the notion that better instructions can overcome the architectural limitations of models.
Developer building LLM inference engine in pure C99. On DeepSeek-V2-Lite with i5-11300H: 1.90 tok/s vs 13.79 for llama.cpp (7.3x gap). Root cause identified: Q4K dequantization to F32 at load (4 bytes/weight) vs direct Q4K reads (0.5 bytes) in llama.cpp. IPC: 0.80 vs 2.36. Required fix: fused Q4K matvec kernel.
Developer highlights the challenge of distinguishing verified facts from inferences in persistent agent memory. Old inferences get promoted to facts over sessions, breaking auditability. He manually implements provenance tagging (verified/inferred/speculative) and asks whether existing solutions (Zep, Mem0, Cognee) address this epistemic layer problem.
Real-time local voice chatbot using Qwen3.5-397B (Unsloth UD-Q3_K_XL), Whisper-small STT, and Orpheus Q4_K_XL TTS with custom SNAC decoder on ONNX. Interruptible with context preservation, 21.3 GB VRAM max on 24GB GPU, bf16 KV cache at 131k tokens. GitHub code coming soon.
Gemma 4 benchmarked on triple GPU setup (3× GTX-1070, 24 GiB VRAM total). Gemma-4-26B-A4B-qat achieves 123.5 t/s prompt processing and 53.08 t/s generation. Gemma-4-E4B-BF16 reaches 302.16 t/s but limited to 11.54 t/s generation. Tests on llama.cpp build 9204 with GGUF quantizations.
A KPMG report on AI was found to contain hallucinations generated by AI. The study reveals inaccuracies and fictional content produced by language models, raising questions about the reliability of AI-generated analysis in professional reports.
User reports unsatisfactory performance running Qwen 3.6-27B on RX 7900 XTX via ROCm and Vulkan with llama.cpp. Prompt processing: 235–634 tok/s depending on backend, generation: 13–31 tok/s. MTP (speculative decoding) n=3 drops generation to 17 tok/s despite 78% acceptance rate.
OpenAI launches Partner Network with $150M investment to accelerate enterprise AI adoption, deployment, and transformation among global partners.
Harbor v0.5.0 enables deploying MLX, OMLX, Docker Model Runner and services (Open WebUI, OpenCode, Hermes) in a single command without manual configuration. Includes skills for coding agents and supports model pulling from Hugging Face and Ollama.
The cloud-based LLM gold rush is ending. Inference costs are falling, competition intensifies, and margins compress. Providers must innovate beyond API access to survive.
Deepseek 4 Flash runs on Mac M3 Max 96GB using Antirez's ds4 engine with SSD streaming. Performance: 11-13 tokens/s decoding, 10s cold boot, 3-5s TTFT. 36k token prefill takes 2m30s. Setup requires iogpu.wired_limit_mb=86016 and --ssd-streaming flag.
KPMG withdraws report on AI usage after discovering apparent hallucinations in the document. The audit firm had to correct factual errors generated by an AI model.
Mirage, a video world model from Microsoft Research, stores scene information in latent space instead of pixel-based point clouds. This cuts compute time and graphics memory while maintaining spatial consistency through long camera moves. Object tracking across segments remains unreliable.
Heretic announces a decentralized backup system for uncensored local models. Models compressed to 9 KB enable phone storage. The project builds takedown-resilient infrastructure with official website and redundant documentation.
Developer builds Bantz, a fully local AI personal assistant with 1920s butler persona running on Gemma 4B. Features Gmail summarization, Google Calendar integration, web search, system monitoring, and Wayland desktop control. CPU-only execution. Motivated by risks of relying on third-party infrastructure (references Anthropic shutdown).
Google Cloud launches Open Knowledge Format (OKF), a standard converting scattered documents into Markdown files with YAML frontmatter, making organizational knowledge portable for AI agents. The format formalizes the "LLM Wiki" pattern popularized by Andrej Karpathy.
Meta reassigns 7,000 employees following May restructuring (10% workforce cuts). Zuckerberg acknowledges mistakes in AI workforce shift and seeks new roles for employees assigned to model training.
Xiaomi serves MiMo V2.5 at 1000-3000 tokens/sec using DFlash and persistent kernel. DFlash model released, open-source availability promised soon.
Critique of agentic loops approach in AI. The article questions the iterative design of autonomous agents, arguing that incrementally adding features does not solve fundamental control and stability issues.
Repository of 100+ open-source clones of popular sites (Airbnb, Amazon, Instagram, Netflix, TikTok, Spotify, WhatsApp, YouTube). Includes source code, demos, tech stack, and GitHub stars.
Rustup is the official Rust toolchain installer. It manages compiler versions, components, and compilation targets for Rust developers.
TensorZero is an open-source LLMOps platform unifying LLM gateway, observability, evaluation, optimization, and experimentation.
Nx is a monorepo platform optimizing builds and CI scaling, with AI agent capabilities to automatically fix failing PRs. Reduces deployment time by half.
Obsidian-wiki is a framework enabling AI agents to build and maintain a digital brain through Obsidian using Karpathy's LLM Wiki pattern.
OpenHands is an open-source framework for AI-driven software development automation. It enables AI agents to autonomously execute coding, debugging, and deployment tasks.
AUTOMATIC1111/stable-diffusion-webui is a popular GitHub repository providing a web interface for Stable Diffusion. Open-source tool enabling image generation through an accessible UI.
KPMG published a report on AI in business containing fabricated case studies involving UBS, the NHS, and other organizations. Edward Tian (GPTZero) helped uncover the errors and warns of 'secondary hallucinations': false claims from trusted consulting firms spreading unchecked. KPMG has withdrawn the report.
Deepseek V4 Flash benchmarks on dual DGX Sparks: 40 tk/s FP8 (single), 350 tk/s aggregate across 32 requests. Compared to RTX Pro 6000 (46 tk/s Q2) and M2 Ultra 192GB (29 tk/s Q2). Requires ConnectX7 200G/s cable ($180) for inter-GPU sync.
AI coding agents like Claude Code find the correct file but miss critical lines within it. The SWE-Explore benchmark shows that without sufficient context, even the best fixes fail.
Open-weight models achieve viable local execution in 2026 through sparse attention, MoE, latent KV compression, multi-token prediction, and 4-bit quantization, without requiring more RAM.
Amazon and five other companies reportedly alerted the Trump administration to security vulnerabilities in Anthropic's Fable model. The White House ordered the model offline via export control within hours, despite Amazon being one of Anthropic's largest investors.
DiffusionGemma suffers from hallucinations in naive inference. A user compiles methods (entropy-bounded sampler, canvas cap, thinking mode) to improve quality with 2–3× speedup gains. Three tiers of solutions: drop-in configs, orchestration wrappers, and custom decoders.
Bastion is an isolated Linux VM-based execution system for background coding agents. Enables safe execution of AI-generated code without risking the host system.
Researcher proposes LOGOS-SIE, a synthetic dataset of 500k observations/beliefs across 5k facts and 100 sources, to test whether modern retrieval systems recover consensus rather than truth. Hypothesis: BM25, dense retrieval, and rerankers favor dominant patterns even when 90% of sources are false.
Paper presented at ACM CAIS 2026 on safety evaluation for tool-using LLM agents. Authors distinguish safe success, unsafe success, and failure, showing verification reduces unsafe success but also decreases task completion as horizon increases ("Verifier Tax"). Two-tier architecture: deterministic policy checks followed by LLM-based verifier.
Developer using Qwen3.6-27B via llama.cpp encounters recurring bugs in Python codebase despite 128K context window. Testing strategies: full project reads vs focused function analysis, KV quantization disabled. Seeking approaches to minimize model errors.
A researcher proposes reducing Q4_0 scale size for Qwen 3.6 27B by replacing scale values (16-bit) with indices (11-bit) pointing to a dictionary. Estimated gain: minimum 318 MB on full model (~31% scale reduction), requiring custom inference code.
WhatsApp claims to have thwarted an NSO spyware campaign. The messaging app detected and blocked an exploitation attempt targeting its users.
Developer seeks LLM model that loops frequently to test loop detection and recovery mechanisms in an agent. GLM Flash at low temperature with extreme quantization identified as problematic. Goal: build scoring framework to detect loops and enable system recovery through backtracking and reprompting.
Pyodide 314.0 enables publishing Python packages built for WASM directly to PyPI (via PEP 783). Previously, Pyodide maintainers manually managed 300+ packages. Package developers can now distribute WASM wheels like native Linux/macOS/Windows wheels.
PR #24260 merged into llama.cpp adds Cohere-MoE architecture support. Users testing North Mini Code models, which are ~3GB smaller in Q8 quantization compared to Qwen 3.6 27B for local inference on homelabs.
A frontier cloud model was globally suspended within 48 hours after a U.S. Commerce Department order restricted access to foreign nationals. The incident highlights cloud dependency risks: a local 70B model remains operational without interruption, slower but autonomous.
Release of luau-wasm 0.1a0, a WebAssembly implementation of the Lua language. The project publishes WASM wheels to PyPI for use with Pyodide, enabling Lua execution in browsers.
Simon Willison uses Claude Code (Opus 4.8) to solve SQL column provenance: programmatically identify the source table.column for each result in complex queries with joins and CTEs. Three solutions found: apsw, ctypes with sqlite3_column_table_name(), and EXPLAIN analysis.
Study reveals ancient genome duplications laid foundations for complex brains. Researchers identified how duplication events enabled evolution of sophisticated brain structures in vertebrates.