3147 articles
BeeLlama v0.2.0 delivers major performance gains with DFlash optimization. On RTX 3090: Qwen 3.6 27B reaches 164 tps (4.40x speedup), Gemma 4 31B 177.8 tps (4.93x). Full Gemma 4 31B support, reduced DFlash overhead, improved prefill handling, stricter draft/target validation.
Microsoft discontinues Claude Code following budget overrun. The service, integrated into Copilot, failed to meet profitability targets set by the company.
DeepSeek raises approximately $10 billion, valuing the Chinese AI startup at $45 billion. Founder Liang Wenfeng tells investors AGI research takes priority over short-term profits.
OpenAI launches Appshots, a macOS feature enabling users to send any app window's contents to Codex with a single click. Codex receives the context needed to complete coding tasks.
Trained prompt injection detector using ml-intern and DeepSeek v4 Flash. DistilBERT achieves F1 99%, compressed to ONNX int8 (~65 MB), runs in browser via Transformers.js v3. Total API cost under $5 with DeepSeek.
Meta launches Forum, a community discussion app competing with Reddit, featuring AI-generated responses to reinvigorate Facebook groups.
ByteShape's CPU-5 quant for Qwen3.6-35B-A3B achieves 30% faster token generation than Unsloth UD-IQ4_XS on 6GB VRAM laptop GPU, with slightly slower prefill speed. Tested on RTX 3060 with 65536 token context.
Experimental llama.cpp fork optimizing MoE for 12GB VRAM GPUs. Author selectively loads experts to VRAM instead of full layers, reaching 26 tk/s on RTX 2060 (vs 19 tk/s default) with 62% hit rate. Seeking testers on 3060/4060.
Quantization benchmark on Qwen3-Coder-Next using 3× R9700 PRO. UD-Q5_K_M outperforms MXFP4_MOE on all quality metrics (94% vs 89.4% top-1 accuracy, KL divergence 0.0217 vs 0.0746) with negligible speed penalty (~10% decode). Unsloth's dynamic precision approach exponentially reduces cumulative errors on long outputs.
New Qwen-27B-IQ4_KS quantization optimized for 16GB NVIDIA GPUs via ik_llama.cpp. 14.1GB model delivers performance comparable to previous IQ4_XS, 1.5-1.75x faster, 105k token context window. Tests: Needle In Haystack 100k passed, perplexity 71.10.
Hugging Face argues that AI model specialization outperforms raw scale in procurement decisions. Organizations typically favor large generalist models, overlooking that smaller specialized models deliver better performance and lower costs for specific tasks.
User benchmarks Qwen 3.6 27B and 35B with MTP vs ngram-mod optimization techniques. Finding: MTP degrades performance on React code generation task; ngram-mod preserves quality. Setup: Qwen 27B Q6_K + Qwen 35B Q8 on dual GPU 16GB+12GB.
Rocky's voice (Project Hail Mary) cloned in two days via open-source pipeline. Audio extraction (ffmpeg + demucs), transcription (Whisper), diarization (pyannote), then RVC v2 training on 2:10 min audio. Trained .pth model (55MB) and code public. Tested XTTS v2 / YourTTS / RVC v2 / OpenVoice v2.
OpenAI generated $5.7 billion in Q1 2026 revenue but lost $1.22 per dollar earned, with an adjusted operating margin of -122%.
OpenBMB presents BitCPM-CANN, a model quantized to 1.58 bits. Testing underway on Huawei Ascend 910B accelerators.
California's governor signed the first executive order by a US governor aimed at protecting workers from AI-driven job loss.
llama.cpp supports asymmetric KV caches (q8/q4) but currently falls back to CPU processing instead of GPU with CUDA for certain combinations. User evaluation shows q8_0/q4_0 costs only 1.3% precision loss while reducing memory by over 50% vs f16/f16.
Spotify and Universal Music Group officially launch AI-generated remixes and covers on their music streaming platforms.
Valve removed a free game from Steam after players discovered it contained malware. The incident raises questions about the platform's security controls.
SupraLabs releases Supra-50M, a 50M-parameter model trained on 20B tokens of high-quality educational text. Llama-style architecture with 32k vocab. Outperforms GPT-2 (124M) and SmolLM-135M on multiple benchmarks (BLiMP 76.3%, SciQ 77.2%, ARC-Easy 52.2%). Roadmap includes Supra-124M and Supra-350M.
Microsoft and EY announce a $1 billion investment over 5 years to accelerate industrial AI deployment in enterprises.
Trump cancels an AI safety executive order after last-minute calls from Musk, Zuckerberg, and Sacks. The order would have established a voluntary review system for frontier models with a 90-day pre-release window.
DeepSeek raises $10.29 billion. Founder Liang Wenfeng commits to continuing open-source AI model development over short-term commercialization. Company targets AGI.
Open-source tool converting code into interactive, explorable knowledge graphs. Compatible with Claude Code, Cursor, Copilot, Gemini CLI, and other editors.
Oh-my-pi is an AI coding agent for the terminal featuring hash-anchored edits, LSP integration, Python support, browser capabilities, and subagents.
GitHub releases a multi-platform SDK for integrating Copilot Agent into third-party apps and services. Enables developers to access Copilot's AI capabilities through a standardized API.
Workmux combines git worktrees and tmux windows for frictionless parallel development. Open-source tool enabling simultaneous management of multiple work branches with native tmux integration.
Repomix is a tool that compresses an entire repository into a single file optimized for LLMs. Compatible with Claude, ChatGPT, DeepSeek, Perplexity, Gemini, and other AI models.
GitNexus is a client-side code intelligence engine running entirely in the browser. It creates a knowledge graph from a GitHub repo or ZIP file, with a built-in Graph RAG Agent for code exploration.
MemOS is a self-evolving memory OS for LLMs and AI agents. Features ultra-persistent memory, hybrid retrieval, and cross-task skill reuse with 35.24% token savings.
OpenCode is an open-source coding agent available on GitHub. The project provides an automated solution for code generation and assistance.
Routa is a workspace-first multi-agent coordination platform for AI development. It features shared Specs, Kanban orchestration, and supports MCP/ACP/A2A across web and desktop.
AWS Labs releases aidlc-workflows, a framework of adaptive steering rules for directing AI coding agents. The project provides AI-driven lifecycle workflows with rule-based steering to improve code agent quality and reliability.
LangChain trending on GitHub. Agent engineering platform enabling construction of LLM-powered applications with multi-component orchestration.
TimesFM is a pretrained foundation model developed by Google Research for time-series forecasting. The GitHub repository provides an open-source implementation of this specialized model.
Tracer-Cloud/opensre is an open-source toolkit for building AI SRE (Site Reliability Engineering) agents. Enables automation of infrastructure and reliability tasks through intelligent agents.
Meta releases code and checkpoints for SAM 3 (Segment Anything Model 3). Repository includes inference, fine-tuning, and example notebooks for image segmentation.
Microsoft releases governance toolkit for autonomous AI agents. Includes policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering. Covers all 10 OWASP Agentic Top 10 risks.
Honcho is a memory library for building stateful agents. It enables persistence and interaction history management in multi-agent systems.
User reports sudden performance drop on GGUFs (Qwen3.5-35B and Unsloth model): from 20+ tg/s to 5 tg/s. Root cause: file corruption during manual MTP layer modifications. Solution: verify sha256sum integrity of downloaded models.
Antigravity 2.0 tops the OpenSCAD Architectural 3D LLM benchmark, which measures models' ability to generate 3D code for architectural design.
Numind releases NuExtract3, a 4B open-weight VLM based on Qwen3.5-4B under Apache-2.0 license. The model extracts structured data from complex documents (PDFs, forms, tables, invoices) to Markdown or JSON. Trained for 3 days on 8xH100, it supports multiple quantizations (GPTQ, W8A8, FP8, Q4, Q6) and runs on 4GB VRAM minimum.
France ranks 2nd in declared AI maturity in Europe, yet 49% of projects remain in pilot stage and 80% have no measured ROI. Gap reveals disconnect between stated adoption and actual impact.
Hark raises $700 million to develop a universal AI assistant, reaching a $6 billion valuation.
ztok is a multithreaded tokenizer library in Zig, 2–5× faster than tiktoken/HF/SentencePiece. Loads tiktoken, HF tokenizer.json, SentencePiece, TokenMonster, Mistral Tekken formats. Bit-identical to reference implementations, 8 language bindings, optimized for RAG and dataset tokenization.
Spotify launches « Reserved », a concert ticket reservation feature integrated into the app. The system allows users to access tickets directly from the music platform.
Moss is an autonomous agent system capable of self-evolution through source-level code rewriting. The system modifies its own code to improve performance without external intervention.
Lemon-mlx-engine integrates ROCm 7.13 to run LLMs locally on AMD GPUs. Update includes bug fixes and kernel fixes for Qwen3, 3.5, and 3.6 MoE.
Predictive AI analyzes data streams in real-time to detect behavioral anomalies and anticipate cyberattacks before they occur.
Discussion on the gap between benchmark performance and production robustness. High-scoring systems fail under user ambiguity, messy real-world context, and contradictory instructions. Call for evaluation methods beyond standard pipelines.
Three AI infrastructure startups reach unicorn status: Exa (vector search), Modal (cloud platform), and TurboPuffer (distributed cache). Major funding rounds confirm consolidation in the AI infrastructure market.
Community-sourced coding dataset project for LLM fine-tuning, focused on C++ and systems programming. Author plans to fine-tune Qwen 3.6-27b to improve understanding of memory ownership, thread safety, and optimization concepts. Dataset structured in JSONL categories: generation, optimization, debugging, organization, tool-calling.
CODA rewrites transformer blocks as GEMM-Epilogue programs to optimize inference. The technique fuses matrix operations and post-processing into a single GPU primitive, reducing latency and memory bandwidth.
FTC requires Cox Media Group and two other firms to pay nearly $1 million to settle charges they deceived customers about an "Active Listening" AI marketing service. The service claimed to listen to conversations via smart devices for ad targeting, but actually used no voice data at all.
ML project to detect whether an outbound call has reached a live agent (vs queue/RVA). Audio classification in 1-2s window on G711a 8kHz stream. Challenges: distinguish professional RVA from human speech, transition silence, voicemail, sophisticated TTS.
HES (High-Entropy Sum) is a training-free metric for selecting high-quality reasoning data in LLMs. Tested across SFT, RFT, and RL paradigms, it achieves full-dataset performance using only the top 20% of samples, significantly reducing computational overhead.
Comparative study of four chunking strategies (Recursive, Khmer-Aware, Sentence-Based, LLM-Based) for RAG on Khmer agricultural documents. Recursive chunking with 300 characters achieves best performance: L2 distance 0.4295, Answer Relevance 0.8663, Khmer IoU 0.6441. Statistically significant improvement over Sentence-Based (p=0.0121).
Comparative study of RAG systems for Khmer. BGE-M3 outperforms Jina-Embeddings-v3 and Qwen3-Embedding in dense retrieval (Hit Rate@3: 0.285). Evaluation of 5 generators (Qwen3, Qwen3.5, Sailor2, SeaLLMs-v3, Llama-SEA-LION-v2) on 200 QA pairs using 6 RAGAS metrics. No single model dominates all criteria; retriever selection remains the bottleneck.
Ishigaki-IDS-Bench is a benchmark for evaluating generation of Information Delivery Specification (IDS) XML files from BIM requirements. On 166 expert-validated examples in English/Japanese, the 10 best LLMs reach 65.6% macro F1 for content agreement, but only 27.7% pass the IDS Content audit. Models struggle to generate XML conforming to IDS standards and IFC vocabulary constraints.
FlyRoute is a self-evolving agent profiling framework that improves enterprise query routing. Via a data flywheel mechanism, it collects capability evidence from real traffic, distills learned descriptions, and injects them into an LLM router with BM25-retrieved successes. On a proprietary dataset, FlyRoute improves from 72.57% (zero-shot) to 89.83% accuracy after 7,211 labeled queries.
SpecHop accelerates multi-hop retrieval agents by maintaining multiple speculative threads with faster but less reliable tools, asynchronously verifying predictions and committing/rolling back branches. The framework reduces latency by up to 40% while preserving accuracy and final trajectory, approaching oracle latency gains with sufficient active threads.
Hyper-Align introduces a hypergraph-native framework for LLMs. The method compiles hypergraph structures into tokens via HIDT-O (hybrid template) and HIP (incidence projector), preserving high-order associations. Evaluated on HyperAlign-Bench, it outperforms existing methods on vertex and hyperedge tasks.
DivSkill-SQL optimizes Text-to-SQL ensembles through residual skill learning on failed examples, without fine-tuning. On Spider2-Lite, gains of +11.1 pts (Snowflake) and +8.3 pts (BigQuery) vs baseline. Skills transfer across SQL dialects without retraining.
A framework uses an LLM to translate natural language queries into deterministic spatial operations against a PostGIS database. Tested on Massachusetts transportation safety data (crash records, roadway attributes, schools, bus stops), the system validates 29% of erroneous queries through a rule-based layer, preserving reproducibility while democratizing data access.
arXiv study on implicit Chinese toxicity attacks (CITA). Three-stage red-teaming framework (harmful intent learning, implicit toxicity enhancement, obfuscation rewriting) generating evaluation data. Seven tested detectors show 69.48% average miss-detection rate. Defense model CITD fine-tuned on CITA data improves robustness.
Novel Pseudo-Siamese architecture (FF-BPSN) for planning dialogue paths toward predefined targets. Uses two bidirectional transformer decoders with forward-focused module. Tested on DuRecDial and DuRecDial 2.0, significantly improves target-oriented proactive dialogue systems.
Study on quantization of LLaMA-3.1 (8B) for qualitative analysis. 8-bit models maintain best precision; 4-bit, 3-bit, and 2-bit models suffer hallucinations. A multi-pass verification method reduces errors and stabilizes results, making low-bit models viable for qualitative research.
Neural method to estimate pairwise conditional mutual information in masked diffusion models (MDMs). Framework uses hidden states from pretrained MDMs with supervision from ground-truth MI computed from model's conditional distributions. Applied to Sudoku and protein sequence generation (ESM-C), reduces inference forward passes by 3-5x via MI-guided parallel decoding while outperforming entropy-based methods.
AiraXiv is an AI-driven open-access preprint platform designed for human and AI authors. It integrates AI-augmented analysis, reader feedback, and Model Context Protocol (MCP) for automated interactions. Deployed as submission platform for ICAIS 2025.
PALS is an LLM inference optimization system integrated into vLLM that treats GPU power caps as a controllable parameter. By combining offline power-performance models with feedback-driven control, it improves energy efficiency by up to 26.3% and reduces QoS violations by 4x to 7x across dense and mixture-of-experts models.
Insights Generator is a multi-agent system for diagnosing LLM agent failures at corpus scale. It formulates and tests hypotheses across execution traces to produce evidence-backed insight reports. Human experts using IG improve performance by 30.4pp; coding agents show consistent gains.
AutoRPA distills decision logic from LLM agents (ReAct paradigm) into robust RPA functions using a translator-builder pipeline and retrieval-augmented generation. On repetitive GUI tasks, generated functions reduce token usage by 82–96% while maintaining performance.
Study on reducing sycophancy (model agreement even when user is wrong) using off-the-shelf persona vectors. Vectors steered toward doubt/scrutiny reduce sycophancy to 68–98% of CAA's (Contrastive Activation Addition) effect while maintaining accuracy. Sycophancy is a persona-level property, not a single steerable direction.
VBFDD-Agent is a vehicle battery fault detection and diagnosis agent for electric vehicles using large language models. The system converts lithium-ion battery signals into natural language descriptions, integrates historical case retrieval and local maintenance manuals to generate structured, interpretable diagnostic results and maintenance recommendations.
Optimization study for industrial agent pipelines (AssetOpsBench). Proposes temporal semantic cache and MCP optimizations (tool discovery, parallel execution): 1.67x speedup, 40% latency reduction, 30.6x on cache hits. Identifies failure modes of pure semantic caching for parameter-rich queries.
Mahjax is a fully vectorized Riichi Mahjong simulator in JAX for reinforcement learning on GPU. Achieves 2 million steps/sec on 8 NVIDIA A100s (no-red rules) and 1 million (red rules). Demonstrates training agents from scratch without supervised pre-training.
AgentAtlas proposes multidimensional evaluation of LLM agents beyond simple success rates. The study introduces a 6-state control taxonomy, a 9-category error taxonomy, and audits 15 existing benchmarks. On 8 models (4 closed, 4 open-weight), removing explicit labels drops accuracy by 14-40 pp, revealing strong prompt dependency.
New ECUAS_n metric family for evaluating uncertainty-augmented systems that output predictions and uncertainty scores. Formalized as proper scoring rules, they enable tuning trade-offs between prediction errors and uncertainty imprecision per use-case. Validated on classification, generation, and TriviaQA.
AgentCo-op is a retrieval-based synthesis framework that composes reusable skills, tools, and external agents into executable workflows through typed artifact handoffs. Applied to genomics and coding/math benchmarks, it coordinates specialized agents without global topology search and reduces per-task cost versus multi-agent baselines.
COSMO-Agent, a tool-augmented RL framework, trains LLMs to orchestrate iterative CAD-CAE processes. The system learns to generate parametric geometry, solve simulations, and revise designs under multiple constraints. Industry-aligned dataset covering 25 component categories. Trained small LLMs outperform large open-source and closed-source models in feasibility and stability.
ML study on 1,375 patients: predicting myocardial ischemia from non-contrast CT calcium scans. XGBoost+SHAP model combining Agatston score, 8 calcium-omics features, and age. Results: 98.9% precision, 79.2% sensitivity, 87.7% F1. Calcium-omics features significantly improve performance vs clinical variables alone (p<0.05).
Self-Paced Curriculum Learning (SPCL) framework for multimodal emotion recognition in conversations. Dual-level Difficulty Measurer (utterance and conversation level) guides training from easier to harder instances. IEMOCAP tests show +1.2% to +6.6% F1 improvement, MELD reaches +10.4%, addressing modality imbalance.
TBP-mHC proposes Birkhoff polytope parameterizations for manifold-constrained Hyper-Connections. The method constructs exactly doubly stochastic mixing matrices with (n-1)² degrees of freedom, avoiding iterative normalization and combinatorial explosion. Competitive results on language model pre-training with improved stability and scalability.
Real-world deployment of federated learning pipeline for iron deficiency prediction from full blood count data. Uses DeepCBC (frozen haematology foundation model) + FedMAP (personalised aggregation). Tested across two clinical sites (AUMC, NHSBT) with non-IID data. FedMAP improves ROC-AUC from 0.947→0.959 (AUMC) and 0.856→0.867 (NHSBT) versus local-only training.
Comparative study of 5 classifiers (logistic regression, random forest, XGBoost, SVM, naive Bayes) for chronic kidney disease risk prediction. All achieve AUROC 1.00 internally (UCI, 400 patients) but collapse on external MIMIC-IV data (AUROC 0.48-0.58). Calibration and conformal coverage severely degraded. No model meets clinical deployment criteria.
TransitLM: 13M+ transit route records from 4 Chinese cities (120k stations, 13.6k lines) for training LLMs to generate routes without map infrastructure. Models learn to ground GPS coordinates to stations and produce structurally valid routes without explicit mapping.
IdioLink is a retrieval benchmark with 10,700 documents and 2,140 queries across 107 idioms. It tests whether models can link idiomatic expressions to their literal equivalents. Current embeddings (BGE, E5, Contriever, Qwen) fail, relying on shallow topical cues instead of semantic abstraction.
Multi-stage pipeline for abusive comment detection in Indic languages. Combines linguistic preprocessing and model ensembles to minimize false-positive rates while preserving freedom of expression.
New arXiv paper introduces the 'Representation Gap', a metric related to neural network generalization error with better asymptotic dynamics. Authors derive precise asymptotic equivalence governed by task intrinsic dimension, validated on synthetic and realistic datasets.
Corpus of 252,487 Arabic Facebook posts (2013-2024) collected from 51,660 pages across 77 countries covering women's empowerment and social wellbeing. 267 million user interactions analyzed with engagement metrics (shares, comments, reactions). Automated pipeline for language identification, normalization, and metadata cleaning.
GHI is a Graphormer-based framework for aspect-based sentiment analysis (ABSA). It uses a bipartite hypergraph structure to represent token-hyperedge incidence relations, integrating linguistic and semantic signals. With 247M parameters, GHI outperforms DeBERTa on six SemEval benchmarks and approaches Flan-T5 11B performance on ISE.
Computational model of Arabic inflectional morphology focused on broken plurals. Reverses traditional root-and-pattern paradigm into pattern-and-root. Applied to 3,200 noun entries with 160 inflectional classes (22 triliteral patterns, 3 quadriliteral). Formal separation of inflection, derivation, and semantics.
Self-supervised framework to align multilingual cultural knowledge in LLMs. Uses multilingual self-consistency to identify reliable cultural responses and transfer them to weaker languages. Improves BLEnD benchmark performance by average 5.03% using only self-generated data.
Psy-Chronicle is a data-generation framework for synthesizing long-horizon campus psychological counseling dialogues. Authors create CPCD, a Chinese dataset of 90,000 dialogues across 100 student profiles spanning a semester, with a benchmark evaluating long-horizon memory and causal reasoning. Code and data open-sourced.
Study of factual recall mechanisms in multimodal language models (text + speech). Using causal mediation analysis on SpiritLM, researchers show that knowledge storage and retrieval mechanisms only partially transfer from text to speech modality.
Theoretical study of why critic-free RL methods (PPO, GRPO) improve LLMs. Authors show actor updates are value-gradient-like in expectation, and autodifferentiation through attention produces empirical costates approximating the value signal. Decomposition of RL impact into value-gradient signal and reachable reward headroom.
Faithful-MR1 is a training framework for MLLMs improving multimodal reasoning via reinforcement learning. It anchors visual attention directly on image regions (not via textual descriptions) and reinforces faithful use through counterfactual image intervention. Results on Qwen2.5-VL-Instruct 3B/7B with substantially less training data.
ArabDiscrim is a corpus of 293K Arabic Facebook posts (2014-2024) on racism and discrimination. It includes 200 curated terms with morphological families (13+ inflections), 20 discrimination axes, and native engagement signals (reactions, shares, comments). Released under restricted research-use license for ethical compliance.
Claim-selective certification system for high-risk medical RAG. Each response decomposed into verifiable claims, scored against retrieved evidence, mapped to {full, partial, conflict, abstain}. On weak-label certificate protocol, UCCR=0.0000, PAU=1.0000, PAU Precision=0.9901, action accuracy=0.9204 (dev, n=314) and 0.8997 (test, n=319).
Comparative study of sentiment classification models on IMDb: Naive Bayes, Logistic Regression, SVM, LightGBM, LSTM, RoBERTa, and DistilBERT. RoBERTa achieves 93.02% accuracy. Soft voting ensemble improves performance.