2731 articles
Theoretical paper establishing sharp lower bounds for higher-order smooth nonconvex optimization. Authors prove ε^(-7/4) rate under Lipschitz Hessians and ε^(-5/3) rate under third-order smoothness are optimal in first-order oracle complexity. Hard instance uses block-chain mechanism for blockwise oracle revelation.
A framework applies tabular foundation models to industrial time series for remaining useful life prediction and diagnostics. By converting unit-level signals into tabular rows, these models outperform transformers and gradient-boosted trees on heterogeneous PHM tasks with high data efficiency.
MAPL (Manifold Aware Projection Learning) compresses inter-stage activations in pipeline parallelism using learned orthogonal projections constrained to Stiefel manifold. Tested on LLaMA 150M–1B, it achieves high compression with negligible performance loss, outperforming Subspace Networks.
Stereological theory of LLM benchmark coverage. For d_eff ∈ [2.86, 4.80], structural blind spot exceeds runner-up score gap by two orders of magnitude. Submodular greedy algorithm identifies 4 stable benchmarks; 7 of 12 suffice for 90% coverage. Validation across 12 internal benchmarks and 27 Chatbot Arena categories.
A study reveals that in zeroth-order (ZO) optimization for LLM fine-tuning, a single decoding layer dominates adaptation. Fine-tuning this dominant layer alone matches or exceeds full-model ZO fine-tuning on LLaMA2-7B and Qwen3-8B, with speedup up to 4.52×. The dominant layer is identifiable before training via activation-outlier analysis.
Multimarginal flow matching with optimal transport potentials. Novel approach combining flow matching and dynamic optimal transport to model temporal evolution with observed intermediate marginals. Simulation-free algorithm (OTP-FM) validated on RNA-seq, oceanographic, and meteorological datasets.
PRECISE extends Prediction-Powered Inference for ranking evaluation by combining small human-labeled sets with large LLM-judged sets using Claude 3 Sonnet. Reduces Precision@4 standard error from 4.45 to 3.50 (−21% relative). In production, correctly identifies best system variant from 100 human labels; A/B testing confirms +407 bps daily sales lift.
Fisher-MoE proposes compressing Mixture-of-Experts models by targeting intermediate FFN dimensions rather than entire experts. On Qwen1.5-MoE, removing just 12 of 1.35M critical dimensions (identified via Fisher importance) preserves performance while reducing memory by ~45% and improving inference throughput by 21%.
Study on optimizing LLMs for cardiac diagnosis via GRPO and rubric-based rewards. A Variance-Aware approach improves Qwen3-14B from 0.362 to 0.502 accuracy and 0.532 to 0.668 F1 on HealthBench, competing with GPT-OSS-120B.
Systematic study of parameter-efficient fine-tuning (LoRA) on Qwen2.5-3B for telecom customer support. 16 LoRA configurations evaluated on 30,000 synthetic examples generated via Gemini 2.0 Flash. Key finding: validation loss (0.5024) does not correlate with quality ranked by GPT-5.2 and Claude 4.5 Sonnet judges. Energy consumption analysis included.
MCBench is a safety benchmark for omnimodal models (vision, audio, text) with 1196 scenarios across 4 safety categories. Evaluations reveal state-of-the-art Omni LLMs struggle to integrate multimodal cues for safety judgments, particularly on subtle risks, despite extracting modality-specific information.
Non-autoregressive scoring method for punctuation restoration in streaming ASR with bounded K-subword lookahead. Preserves input transcript, decides at word boundaries via hypothesis comparison. IWSLT 2017: macro F1 0.893 without fine-tuning (K=2) and 0.937 with fine-tuning, outperforming prompt-based and ELECTRA baselines.
Novel Multi-Granularity Reasoning Network (MGRN) for Natural Language Inference leveraging hierarchical semantic features across lexical, phrasal, and contextual granularities in an interactive reasoning space. Outperforms baseline models on multiple public benchmarks.
Longitudinal audit of sycophancy across six Gemini variants (2.0, 2.5, 3.0) on 73 adversarial prompts. 27.2% of responses contain substantial sycophantic content (Likert ≥2), masked by binary metrics. Gen 2.5 regresses (2.64 vs 1.90 Gen 2.0), Gen 3.0 recovers (2.01). Strong negative correlation (rho=-0.63) between sycophancy and truthfulness.
LoRi introduces low-rank distillation to internalize reasoning in LLMs. The method aligns hidden trajectories of teacher and student models in a shared low-rank tensor subspace. Evaluated on LLaMA and Qwen, it improves performance on multi-step mathematical reasoning and approaches explicit CoT accuracy.
BUMP is a self-supervised framework generating textual user profiles for LLM personalization. Trained via GRPO on bidirectional ranking objectives (profile vs interactions, interactions vs profiles), it requires no labeled supervision. Evaluated on LaMP, BUMP matches or outperforms closed-source APIs without task labels.
Anomaly detection for Electro-Hydrostatic Actuators (EHAs) using LSTM autoencoder. Model achieves 99.0% average accuracy, up to 100% precision, and F1-scores of 93.1–99.8% on temperature and pressure sensor data. Outperforms classical methods (Z-score, Isolation Forest, k-means) by capturing temporal dependencies.
First sharp thresholds for low-degree polynomial tests in planted-vs-planted settings. Matching upper and lower bounds for community counting in planted submatrix and planted dense subgraph models. Testing threshold coincides with known low-degree recovery threshold down to sharp constant.
System automatically discovers executable schemas from heterogeneous multi-source data (tables, documents, semi-structured files). Schema serves as shared contract for knowledge graph construction and query-time routing via multi-tool agent (structured lookup, graph traversal, vector search). Improves over retrieval-only and decomposition baselines across four QA benchmarks in zero-shot setting.
Multilingual coreference resolution pipeline using cycle-consistent machine translation (English → target language → English) to generate training data. Translation quality validated via cosine similarity in BERT latent space. Significant performance gains on 4 low-resource languages.
Multi-model adaptive framework for abstractive text summarization. Integrates multiple fine-tuned transformers on CNN/DailyMail, selects best summary via automatic metrics (BERTScore 88.63%). Outperforms GPT3-D2, Falcon-7b, Mpt-7b.
Domain-aware coreset selection pipeline for near-real-time flood depth prediction. Uses tabular foundation model conditioned at inference time. Achieves R²=0.663 across nine Houston-area watersheds with 0.7% of training data, without per-watershed retraining.
Personal LLM server built: AMD EPYC 9575F (64C/128T), 4× RTX 3090 (96GB VRAM), 768GB ECC RAM. Planned for vLLM small-model high-throughput and llamacpp larger reasoning models. Use case: AI inference for NPC planning in space simulation.
User runs Qwen 3.6 35B on RTX 3080 10GB + Ryzen 7700X. Achieves 1400t/s prefill and 26t/s generation at 131k context. Optimized for agentic research and document processing using llama.cpp.
TokenAI announces Horus Lens 1.0, first open-source image generation model developed entirely in Egypt. Specialized family of text-to-image models, marking a major milestone for Egypt's and the Arab world's AI ecosystem.
proveKV: open-source KV-cache compression technique for LLMs. Results: 36× lossless memory reduction vs f32, 18× vs fp16 on SmolLM2-1.7B + WikiText-2 (0% PPL regression). Automated audit pipeline with reproducible validation.
A r/LocalLLaMA user describes how LLM-driven NPCs are implemented in Ultima Online using ServUO. The system integrates local language models to generate dynamic dialogue and behavior for non-player characters.
Study demonstrates that RAG systems without persona modeling fail to capture clinical relevance for patients. Lack of personalization context reduces effectiveness of medical responses.
Complete YouTube workshop on building LLMs from scratch (GPT-2 & Qwen 3.6 style) with no math prerequisites. Covers ML fundamentals, transformers, neural architecture, tokenization, attention, pre-training, instruction tuning, RL. Format: slides + Excel examples + PyTorch/CUDA code.
A researcher solves an ARC-AGI-3 task with 4.76% score using only deterministic Python code and classical computer vision on a 2012 AMD FX-8350 CPU. No LLMs, no transformers: color blob segmentation, centroid detection, and spatial clicks. Shows frontier models fail at 0% on these dynamic environments.
Vercel Sandbox now supports Drives in private beta: persistent, attachable storage independent from sandbox lifecycle. Create a drive once, mount it at a configurable path when starting a sandbox, and it persists after sandbox stops. Useful for agent workspaces, cloned repositories, and data management decoupled from sandbox lifecycle.
Vercel launches skills.sh API to query 600,000+ skills from open-source ecosystem. Authentication via short-lived OIDC token, 600 req/min rate limit per project, access to security audits.
Charity Majors analyzes the tension between AI enthusiasts (seeing discontinuous capability gains and existential threat in ignoring AI) and skeptics (fearing reliability degradation, loss of context, team burnout). The challenge: design feedback loops connecting both groups to reconcile their divergent realities.
South Korea mandates online forums to scan all images using AI censorship tools to detect illegal content. This regulatory requirement affects digital platforms in the country.
Systematic study of QKV variants in transformers. Researchers examine whether all three projections (Query, Key, Value) are necessary for model efficiency. Comparative analysis of alternative architectures.
Latent Agents introduces a post-training procedure using internalized multi-agent debate. The method trains a single model to simulate multiple agents debating internally to improve reasoning and complex problem-solving.
User fixes Xid 79 error (GPU fallen off PCIe bus) on RTX 3090 by cleaning dust from PCIe riser connector with brush and 91% isopropyl alcohol. Prior software fixes (power limiting, kernel parameters) had failed.
Demonstration of formally verified polygon intersection solved in a single attempt with Claude Opus 4.8, where previous versions failed.
BeeLlama v0.3.1 updates llama.cpp with MTP, Gemma 4 12B support, multi-GPU DFlash, and new cache options (q6_0, TQ3_1S, TQ4_1S). On RTX 3090, Qwen 3.6 27B reaches 177.8 tps (4.93x baseline), Gemma 4 31B also optimized. Prebuilt binaries and Docker images provided.
AI data centers will consume as much water by 2030 as 1.3 billion people. Model training and inference require massive cooling volumes. This projection raises critical environmental sustainability concerns.
Interview with VendingBench authors on evaluating Claude models from Haiku to Mythos. Discussion on building leading, reproducible frontier evaluations from scratch.
cyankiwi releases AWQ 4-bit update with NVFP4 and FP8 Dynamic quantization support. KL divergence benchmarks on Qwen3.6 27B and 35B-A3B: cyankiwi/Qwen3.6-27B-AWQ-INT4 achieves 0.020443 KLD (best dense), cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit achieves 0.017126 KLD (best MoE).
Anthropic releases an open-source framework for automated vulnerability discovery powered by AI. The tool leverages model reasoning capabilities to identify security flaws in code.
User compares Qwen 3.6 35B and 27B with different quantizations. Qwen 35B IQ4NXL without quantized KV cache outperforms Qwen 27B Q5 KXL with KV Q8/8 on agentic tasks. Quantized KV cache significantly impacts performance in long context, contrary to previous claims.
Engineer builds native 1-bit LLM inference engine in pure Rust, bypassing PyTorch and CUDA. Demonstrates 150+ tokens/sec and 350MB RAM footprint on edge CPUs with quantized TinyLlama. Introduces proprietary residual error recovery algorithm achieving 16x compression while maintaining fluency.
Castor is an advanced storage manager developed by CERN to handle massive data volumes from its experiments. The project provides infrastructure for efficient large-scale scientific data storage and retrieval.
User reports severe performance degradation with Qwen 3.6 27B Q4_K_XL quantization on RX 7900 XTX with llama.cpp: prompt processing speed drops from 161 tokens/s (2048 tokens) to 20 tokens/s (12288 tokens). Setup: ctx-size 90000, flash-attn enabled, all layers in VRAM.
NVIDIA releases Nemotron 3.5 Content Safety, an open-source multimodal safety model detecting harmful content across text, image, and video. Customizable for global enterprises, it provides granular policy control for moderation across regions and use cases.
Cloudflare CEO Matthew Prince states bot traffic now exceeds human traffic on the internet, years ahead of his late 2027 forecast. He attributes the surge to AI agents. His conclusion for the web's future: "pay to crawl."
Developer proposes optimization for llama.cpp: dynamic KV cache quantization and on-demand mmproj loading. PoC implementation with HTTP endpoint /requantize_kvcache enabling config switching (quantized/f16 kvcache, mmproj on/off) without full model reload. Tested on RTX 5090 with Qwen3.5-27B Q6_K.
Reproduction study on r/LocalLLaMA testing the impact of operating system (FreeBSD) on open-weight local model performance. Mythos's FreeBSD Find used as case study to evaluate whether system environment influences open-source LLM results.
Vercel updates Terms of Service to clarify shared responsibility when AI tools (Vercel or third-party) take actions on accounts. New concepts: AI Functionality (Vercel AI services) and Third-Party Tools (external tools). Changes: billing revised, enterprise email domains claimable, new customer representations added.
Custom quantization experiment on Qwen 3.6 27B: BF16→Q8_0 conversion targeting high-variance layers. Q8-CC model (30.47 GiB) achieves 98.358% vs UD Q8_K_XL (33.31 GiB) at 97.426% on wiki.test.raw. Mean KLD: 0.011324 vs 0.012100. Preliminary results without real-world performance benchmarks.
NVIDIA releases Nemotron 3 Ultra, a 550B parameter model with 55B active parameters and 1M token context window. Mixture-of-Experts architecture designed for efficient inference.
User reports llama.cpp built with Vulkan + OpenBLAS fits 28% more context (112,896 tokens vs 87,808) on Qwen 3.6 27B. Cause unclear: expected behavior, bug, or measurement artifact.
Agentcodec unifies 28 LLM reliability techniques (retries, ensembling, verification, adaptive routing) under a single API. Adoption via one-line import change. On Nemotron + Devstral + GLM-5.1, adaptive router achieves 56% cost reduction at matched quality, or 7% quality gain at matched cost. Single λ parameter controls the trade-off.
ChatGPT upgrades its "Dreaming" memory system to build coherent user profiles from conversations, organized by themes (work, hobbies, travel). Success rate for keeping information current increases from 52.2% to 75.1%.
A user discovered one RTX 3090 was connected to a hidden PCIe 2.0 x4 slot on a Gigabyte X399 board, crippling performance to 11 tok/s on Mistral 128B. After repositioning GPUs and proper tensor-split configuration, throughput doubled to 24.7 tok/s. Warning for multi-GPU builds on older HEDT boards.
NVIDIA releases Nemotron 3 Ultra, a model optimized for reasoning and long-running agents. Available via NVIDIA developer blog.
Chinese agents use LinkedIn with fake profiles to target Western professionals holding sensitive information. The campaign aims to collect data through social engineering.
Google asked 404 Media to revise its official statement after publishing an article about internal memes criticizing its AI systems. The revised version removed language about keeping humans in the loop.
Article exploring progress toward recursive self-improvement in AI systems. Discusses mechanisms by which models could optimize themselves and implications for future AI development.
Bain survey of 951 companies: 40% achieve less than 10% AI cost savings despite targeting 11-20%. Only 7% deploy fully autonomous AI agents, contradicting their business case assumptions.
Unsloth announces early support for Apple Silicon. The LLM fine-tuning optimization platform is preparing a native version for Apple M-series processors, improving training performance on Mac.
Spanlens, an MIT open-source tool, enables LLM agent debugging by changing a single line of code (baseURL). It traces multi-step calls, integrates OpenAI/Anthropic/Gemini, masks sensitive data, and allows Docker self-hosting without vendor lock-in.
Timnit Gebru, fired by Google in 2020 after raising concerns about LLM risks, was right: her warnings about bias, environmental impact, and ethical issues have materialized. The article revisits her predictions and their validation by recent events.
Huawei releases KVarN, a native KV-cache quantization backend for vLLM. Optimizes memory and inference latency for LLMs without significant quality degradation.
Detailed benchmark of Qwen3.6-27B on 2x RTX 3090 comparing llama.cpp (Q6_K/Q8_0) and vLLM (INT4/INT8). Real measurements: throughput 43-54 tok/s, MTP acceptance rates 27-77% per backend. Setup with OpenAI-compatible proxy hot-swapping 4 configs, no PCIe P2P (Threadripper 1950X).
Researcher tests uncertainty calibration in LLM agents using planning + verification pipeline. Verification catches 60% of hallucinated tool calls before execution, but reduces easy correct answers by half. Solution: flag low-confidence tasks for human review, auto-execute high-confidence ones.
NVIDIA releases Nemotron 3 Ultra, an open source model with 550 billion parameters. It is the company's largest open source model to date.
Huawei open-sources KVarN, a KV-cache quantization method (Apache 2.0, vLLM single-flag integration). 3–5× compression vs FP16, throughput up to 1.4× FP16, maintains reasoning quality unlike TurboQuant (Google). No retraining, no calibration required.
Dashlane, a password manager, suffered a brute force attack according to a notice published Monday. The company refuses to disclose details about the security incident.
Boxes.dev enables running Claude Code and Codex in the cloud without localhost. Cloud development platform for Anthropic and OpenAI models.
Technical deep-dive into FAISS, Meta's library for billion-scale similarity search. Covers internal architecture, indexing algorithms, and optimizations for massive query workloads.
Open-source practical guide to LLM engineering patterns: RAG, hybrid retrieval, rerankers, evaluation. Covers pre-filtering, in-memory scoring vs vector databases, batching, cleanup. Python examples included. Author emphasizes engineering harness quality matches model quality for production solutions.
Sam Altman (OpenAI) identifies "proactive AI" as next phase after chatbots and agents: systems running continuously in background, acting without user prompts. Context: companies facing spiraling AI costs and lack of usage skills. Promise: "more value for less spend."
KVarN is a KV-Cache quantization method combining Hadamard rotations with variance-normalization on K and V matrices. Achieves 3-4x compression with 0-1% accuracy drop on AIME24 and speedup over fp16 baseline in vLLM. Optimized for decode-heavy settings (reasoning, code-gen, agents).
Nvidia releases Nemotron 3 Ultra, an open-source hybrid Mamba-Transformer model with Mixture-of-Experts (MoE) architecture optimized for agentic reasoning. 405B parameter model combining efficiency with advanced reasoning capabilities.
Hugging Face releases a guide to fine-tune Nemotron 3.5 ASR, NVIDIA's speech recognition model. The method enables adapting the model to specific languages, domains, or accents through fine-tuning.
User reports Gemma 4 12B repeatedly fails basic tool calls with opencode (e.g., specifying "pattern" parameter for grep correctly). Model grasps the task but wastes resources on failed attempts. Questions whether opencode lacks Gemma 4 12B compatibility or if alternative harness exists for reliable tool calling.
On-policy distillation (OPD) is a key post-training technique used by Qwen 3.6/3.7, GLM-5.1, and DeepSeek-V4. The method uses an auxiliary model to identify errors in trajectories and inject correction tokens, allowing the main model to learn without regenerating new rollouts.
Hugging Face releases EVA-Bench Data 2.0, a benchmark spanning 3 domains, 121 tools, and 213 scenarios to evaluate multi-tool AI agents. Major expansion from previous version to test models' ability to orchestrate complex tool interactions.
Amazon is developing an AI system that can find products based on descriptions without knowing the exact name. The technology uses vision and natural language processing to match user queries with the catalog. The article notes a remaining accuracy issue.
BC250 benchmark with Llama-cpp (Vulkan) on Fedora 44. Tests at stock, with Cyan governor and 2GHz overclock, then 40 CU unlock. Hipfire compilation attempt failed: ROCm 6.X incompatibility vs BC250 support limited to 5.X.
Endava uses AI agents, ChatGPT Enterprise, and Codex to accelerate software delivery, automate workflows, and build an AI-native culture across the enterprise.
NVIDIA releases Nemotron-3-Ultra-550B, frontier-scale model with 550B parameters (55B active) using LatentMoE hybrid architecture combining Mamba-2, MoE, and Attention layers. Supports up to 1M token context, configurable reasoning mode, optimized for complex agents and high-stakes RAG. OpenMDW license, 11 languages.
NVIDIA releases Cosmos, an open platform of world models, datasets, and tools enabling developers to build Physical AI for robots, autonomous vehicles, smart infrastructure, and more.
AI agent that researches any topic across Reddit, X, YouTube, Hacker News, Polymarket, and the web, then synthesizes a grounded summary.
PaddleOCR is a lightweight, open-source OCR toolkit that converts PDF and image documents into structured data. Supports 100+ languages and integrates with LLMs.
GitHub releases a multi-platform SDK to integrate GitHub Copilot Agent into third-party applications and services.
Lightweight desktop app to manage, sync, and organize AI agent skills across 15+ coding tools — Cursor, Claude Code, Codex, Copilot, and more.
Microsoft releases mxc, an open-source security tool implementing policy-driven, layered isolation and containment. Designed to strengthen container and runtime environment security.
OpenSpec: spec-driven development framework for AI coding assistants. Structured approach to generate code from formal specifications.
NVIDIA releases NemoClaw, a framework to run AI agents (Hermes, OpenClaw) securely within NVIDIA OpenShell with managed inference.
Nginx Proxy Manager: Docker container for managing Nginx proxy hosts through a simple, powerful interface. Open-source infrastructure tool for centralized proxy configuration management.
Dify is a production-ready platform for agentic workflow development. It enables creation and deployment of complex AI agents through a visual interface.
omlx is an LLM inference server with continuous batching and SSD caching, optimized for Apple Silicon and managed from the macOS menu bar.
AI agent that researches any topic across Reddit, X, YouTube, Hacker News, Polymarket, and the web, then synthesizes a grounded summary from multiple sources.
Pixelle-Video is an AI-powered automated short video generation engine. The GitHub project provides an end-to-end solution for creating short videos without manual intervention.
Cost.dev (YC W21) makes AI agents cost-aware and reduces API call expenses. The tool optimizes spending for autonomous agent execution.