2731 articles
A Derbyshire Police officer is accused of using AI to fabricate evidence in a criminal investigation. The case raises concerns about digital evidence integrity and law enforcement accountability regarding AI tools.
User runs Gemma 12B QAT on GTX 1080 Ti (9 years old) at 50 tok/sec. Setup includes speculative decoding with MTP draft model and Q4_K_XL quantization. Seeking further optimizations.
Work-in-progress implementation of EAGLE3 inference acceleration adapted for Qwen models. Software modification enabling faster token generation with Qwen-based systems.
Snapcompact is an image compression technique that reduces token consumption in vision models. It optimizes visual representation without significant quality loss, enabling faster and cheaper inference.
Developer building open-source ML course in Jupyter Notebooks, bilingual (English/Persian). Covers fundamentals, preprocessing, regression, classification, trees, clustering, time series, MLOps. Seeking feedback on chapter order, missing classical ML topics, and bilingual notebook utility for non-native learners.
User questions DeepSeek v4 Pro's (1.6T parameters) relevance given mediocre performance versus smaller models: GLM 5.2 (750B), Kimi K2.7 (1T), MiniMax M3 (450B), and MiMo v2.5 Pro (1T) outperform it on benchmarks. Questions whether the model's value lies primarily in Huawei-based inference infrastructure rather than model quality.
Cohere Labs releases North Mini Code, a 30B-parameter MoE model (3B active) optimized for code generation and agentic software engineering. Architectural support added to llama.cpp. Apache 2.0 license, 256K context window.
User reports 80+ tokens/s with Qwen 3.6 27B Q8 quantization on dual GPU setup (RTX 5080 + RTX 3090). Performance measured on local hardware without framework or test condition details.
Count Anything is an AI model capable of counting objects in any type of image via text prompt. It halves the error rate compared to previous systems, but still struggles with extremely dense objects and ambiguous terms.
Practical guide for archiving local LLMs: BD-R XL M-DISC 128GB Blu-Ray disks ($12-14 each) offer best consumer archival durability (10 human lifespans). Compatible burners: ASUS 16D1X-U (~$100-250), LG/Buffalo alternatives from $80. M-DISC preferred over volatile USB storage.
SupraLabs releases Supra-1.5-50M family (Base, Instruct, GGUF). Main upgrade: context expanded from 1,024 to 5,120 tokens via RoPE scaling. Continued pretraining on 3B tokens (tool calling, ChatML, factual text, math). BLiMP: 67.4. Experimental models under Project Chimera.
Satya Nadella (Microsoft) warns against "token-maxing"—throwing frontier AI models at every problem. Marginal productivity gains must justify token costs. Paradoxically, he admits being a "token-maxer" himself and that it's "addictive."
Google Research's Gemini-SQL2, built on Gemini 3.1 Pro, achieves 80.04% accuracy on the BIRD benchmark for natural language-to-SQL conversion, significantly outperforming OpenAI and Anthropic. Google plans to integrate this technology into its data services.
Microsoft and three Chinese universities developed SkillOpt, a method optimizing instruction documents for AI agents using classical training principles. A simple Markdown file boosts GPT-5.5 by ~23 points on procedural tasks and transfers across models (Codex, Claude Code).
Prism, a 32-bit cross-platform coding agent, starts in under one second on Pentium M with <1% CPU usage. Supports sub-agents, local/cloud models, plugins. 500 KB, compatible with 386+. GitHub release planned.
An AI open-source tool repository was archived overnight after the project raised $7.3M in seed funding. Exact reasons for the archival remain unclear from available details.
llama-launcher v1.3 adds Bayesian optimization via Optuna to automatically tune llama-server parameters. The tool reports up to 15% speed improvement on Gemma 12B MTP with no manual intervention.
GLM 5.2 released, open weights coming next week. One-shot Pac-Man test: better results than GLM 5.1 despite 70 tok/s slowdown. Game nearly functional in single attempt, fully playable after one follow-up prompt. Ranks first ahead of Qwen 3.5 27b.
User shares Pi setup with Qwen 3.6-27B that replaces Claude Code for daily coding tasks. Features seamless local model onboarding, token/cost/speed display, 10 themes, configurable permissions, context breakdown, and sync scripts.
Chatwoot is an open-source omnichannel customer support platform (live chat, email, ticketing). Alternative to Intercom, Zendesk, and Salesforce Service Cloud.
AgentsView provides local-first session intelligence and analytics for coding agents, supporting Claude Code, Codex, and 20+ other agents. 100x faster replacement for ccusage.
aisuite is an open-source unified interface to access multiple generative AI providers (OpenAI, Anthropic, Google, etc.) through a common API. Simplifies multi-model integration in production.
Databend announces complete rebuild of its data warehouse platform. Unified architecture on S3 supporting analytics, search, AI, and Python sandbox in a single system.
LobeHub organizes AI agents into 24/7 operations through hiring, scheduling, and reporting. Platform for managing autonomous agent teams.
Vercel releases AI SDK, a free open-source TypeScript library for building AI-powered applications and agents. Tool from Next.js creators.
SkyPilot enables running, managing, and scaling AI workloads across any infrastructure (Kubernetes, Slurm, 20+ clouds, on-prem) through a single unified system.
aisuite: unified interface to access multiple generative AI providers (OpenAI, Anthropic, Google, etc.) through a common API. Open-source project designed to simplify multi-model integration.
NVIDIA releases PhysicsNeMo, an open-source deep-learning framework for building, training, and fine-tuning models using state-of-the-art Physics-ML methods.
GLM 5.2 deployed in GLM Coding Plan with 1M context window and two thinking modes (max/high). API and MIT-licensed weights available within a week. Community voting on X for priorities.
KPMG's AI report contains AI hallucinations: fabricated data, invented citations, and non-existent references. An ironic case of a document about AI that demonstrates its current failures.
Anthropic's Claude Fable 5 achieves 88% accuracy on FrontierMath's hardest tier, versus 75% for OpenAI's GPT-5.5. Massive jump from Opus 4.5 (< 10% early 2026).
Meta faces internal AI costs reaching billions of dollars. Starting 2027, a token governance system via "AI Gateway" dashboard will limit consumption. CTO Andrew Bosworth criticizes "tokenmaxxing": token usage alone does not measure real impact.
A security vulnerability discovered in Fable 5 demonstrates that AI guardrails alone are insufficient to prevent jailbreaks. The study highlights the need for multilayered security approaches beyond simple model restrictions.
Unsloth releases a GGUF quantized version of Kimi-K2.7-Code model on Hugging Face. The model is currently being uploaded.
A researcher reports that a coauthor added LLM-hallucinated references to a paper at the last minute. Despite the coauthor's assurance, all new references contained errors. The paper was withdrawn after reviewer detection, damaging all authors' reputations.
Discussion on decentralized distribution of open-source LLM models. Author proposes prioritizing sharing of unquantized base models (fp16/bf16) over derived variants, arguing base models are essential primary data to preserve against growing restrictions from closed model providers.
Moonshot AI releases Kimi K2.7 Code, an open-weights model with one trillion parameters for programming. Underperforms GPT-5.5 and Claude Opus 4.8 on coding benchmarks but costs up to 12x less per token, offering better value for constrained budgets.
Zyphra releases ZONOS2, an open-source TTS model (Apache 2.0) with 8B parameters and 900M active at inference. Sparse MoE focused on zero-shot high-fidelity voice cloning (44.1 kHz DAC). Prosody score 88.7, outperforming Qwen 3 TTS (87.6) and ElevenLabs V3 (83.2). Trained on 6M+ audio hours, reads raw UTF-8 without phonemizer.
inclusionAI releases VISTA-9B and VISTA-4B, vision-language models built on Qwen 3.5 backbones for GUI grounding. Trained with VISTA (View-Consistent Self-Verified Training), they map screenshots + natural-language instructions to normalized click coordinates 0-1000. Uses GRPO with target-preserving views and self-verified cross-view anchoring.
US government ordered Anthropic to disable Claude Fable 5 and Mythos 5 globally, citing jailbreak risks. Anthropic complies but disputes: vulnerabilities are minor and exist in GPT-5.5. Company warns precedent could halt all frontier deployments.
On June 12, 2026, a U.S. government directive forces Anthropic to suspend Fable 5 and Mythos 5 for all users, citing jailbreak risk. Anthropic complies but contests, arguing a potential narrow workaround does not justify recalling a widely deployed model.
Zhipu AI announces GLM-5.2 next week as open weights under MIT license. No technical details provided in the Reddit post.
C++ implementation of PaddleOCR (v3 through v6) using ncnn for inference. Replaces the complex official Paddle runtime with ncnn, which is lighter and faster. Code available on GitHub.
Anthropic disabled Fable 5 globally due to sudden US export ban, unable to instantly verify cloud users' nationality. Post argues cloud APIs are rented and revocable for compliance reasons, while local weights provide guaranteed control and independence.
Fable 5 dataset released on Hugging Face containing 953 traces and CoT data before model removal. Fine-tuned models based on this data expected soon.
Rio-3.5-Open-397B, a Qwen 397B fine-tune developed by Rio de Janeiro's city government, released open-source on Hugging Face. Performance reportedly matches Qwen 3.7 Plus.
Derivative-free optimization of a neural network on MNIST: 784-32-10 architecture (25,450 parameters). MDP achieves 93.7% validation and 93.4% test accuracy, outperforming Adam (91.8%/91.7%). Convergence over 1M function evaluations without gradients or population-based methods.
US government ordered Anthropic to suspend access to Fable 5 and Mythos 5 for all users citing national security concerns. The directive cites risk of a 'jailbreak' method bypassing model safeguards. Anthropic disputes this: identified vulnerabilities are minor and available on other public models including OpenAI's GPT-5.5.
Vercel Workflow SDK now integrates natively with Nitro v3 in beta. Steps run in the same runtime as the app with direct access to server APIs. Web UI for monitoring available at /_workflow. Optimized bundling with tree-shaking reduces bundle size.
H100 (FP8) benchmark: DiffusionGemma 26B generates 763 tok/s (3.7s) vs Gemma4 218 tok/s (15.1s), but produces 28 factual errors across 61 tested facts vs 5 for Gemma4. DiffusionGemma invents names, dates, numbers (Clara Clley as Jobs' mother, BeBox at $9,999 instead of $1,600). The diffusion model generates 256 tokens simultaneously and polishes text without verifying factuality.
Simon Willison updated his OpenAI WebRTC tool to support GPT-Realtime-2 model (GPT-5-class reasoning) and added document context feature. Users can now paste text to have audio conversations about specific documents directly in the browser.
MiniMax M3 on Hugging Face falls back to dense attention as sparse attention is not yet supported. This potentially means all weights (428B) are used at each step, with significant performance impact.
Web tool to select your GPU and display compatible open-weight models ranked by quality and context size. Removes guesswork about VRAM compatibility.
User converted four RTX PRO 6000 Blackwell cards to water cooling, discovered a loose VRM choke component, and achieved 41k tokens/s throughput. Hardware optimization experience for LLM inference.
Prometheus, physical AI startup co-founded by Jeff Bezos and Vik Bajaj in late 2025, raises $12B Series B at $41B valuation. JPMorgan and Goldman Sachs participate in the round.
User finetuned Pythia-6.9B for 550 steps on instruction following datasets. The finetuned model gained ability to handle 13 languages versus nearly none in base model. Merged model released on Hugging Face.
Anthropic surveyed 52,000 Americans on AI hopes and fears. 64% fear job losses, 56% worry about losing independent thinking. Daily AI users show less concern. Most people reject AI in their own workplace, even for tasks they believe it can handle.
Google integrates Gemini into Google TV to adjust image settings. The feature enables AI to control visual parameters, but limitations remain according to the article.
Practical guide to setting up a local coding agent on macOS. Covers installation and configuration of AI tools for code assistance in a local environment.
OpenAI lets Codex users bank and manually trigger rate-limit resets instead of waiting for fixed schedules. Go, Plus, Pro, and Business plans get one free reset; Plus and Pro users can unlock additional resets by inviting friends.
Claude Fable 5 scores 64.9 points on the Artificial Analysis Intelligence Index and sets records on 5 of 10 benchmarks. Performance gain over Opus 4.8 is only 5.7% while token costs double. Safety filters with fallback routing further increase expenses.
BitBoard, YC P25 startup, launches an analytics workspace for AI agents. The platform enables monitoring, debugging, and optimizing multi-agent systems in production.
PWA support merged into llama.cpp (PR #23871). The llama-server web UI can now install as a native app on desktop/home screen, with standalone window mode and proper icons for faster reopening and better caching.
Dual-GPU benchmark (2× RTX 3080 20GB) comparing llama.cpp (row/tensor split) vs ik_llama (graph split) on Qwen3.6-27B-Q8_0. Row split: 1732 t/s prompt, 23 t/s generation, VRAM 18.2/18.5 GB. Tensor and graph split results incomplete in excerpt.
Hugging Face releases olmo-eval, an evaluation workbench for the model development loop. The tool automates performance testing and enables rapid iteration during language model training and fine-tuning.
User shares a script to bulk delete Claude conversations from the web UI. Practical tool for cleaning chat history without manual actions.
Unsloth releases GGUF versions of MiniMax M3 model on Hugging Face. Upload in progress.
OVH Groupe is in exclusive negotiations to acquire Gladia, a French startup specializing in speech recognition and AI transcription. The acquisition aims to strengthen OVH's sovereign cloud offering by adding native audio processing capabilities.
MiniMax introduces MSA (Sparse Attention), a blockwise sparse attention built on GQA for ultra-long contexts (up to 1M tokens). On a 109B multimodal model, MSA reduces per-token attention compute by 28.4x at 1M context, with 14.2x prefill and 7.6x decoding speedups on H800. Code and MiniMax-M3 model released.
MiniMax M3 is now available on HuggingChat with Artifacts support. The model can generate code and structured content directly in the interface.
User reports successful two-shot prompting with Qwen 3.6 35B via llama.cpp on RTX 3060 12GB. Task: generate FFT spectral animation from audio file in Python with 1980s-style display. Model correctly iterated on refinements (skip first 200ms, reduce spectrum range, apply log transform).
Google and OpenAI separately exposed operations allegedly originating in China using AI for fraud and covert influence campaigns within days of each other. Google filed a joint lawsuit with the FBI. Both target US infrastructure and political debates.
Apple integrates Google's Gemini into Siri at WWDC on June 8, but not as the primary engine. The article challenges the dominant interpretation of this partnership and explores Gemini's actual role in Siri AI's architecture.
MiniMax-M3 weights released on Hugging Face. Model has 428B total parameters with 23B activated parameters (MoE architecture).
A randomized controlled trial (arXiv, April) measures the impact of learning with GPT-5 on skill retention after assistant removal. Results quantify the cognitive cost of AI dependency.
OpenAI filed a confidential S-1 with the SEC on June 9, eight days after Anthropic. Both AI companies are preparing IPOs, disclosing financial data previously hidden in private valuations.
Lille hosts the « L'IA avec nous » summit on June 12 at EuraTechnologies with 1,000+ participants and 50 speakers. The event tests positioning of a European applied AI valley, bringing together French and international stakeholders around concrete use cases.
Mistral AI is negotiating a funding round of approximately 3 billion euros at a valuation of around 20 billion euros to fund its European AI expansion.
LMCache is an optimized KV cache layer designed to accelerate LLM inference. The open-source GitHub project aims to reduce latency and memory consumption during token processing.
Cocoindex is an incremental engine for long-horizon agents. Open-source project trending on GitHub.
Insomnia is an open-source, cross-platform API client supporting GraphQL, REST, WebSockets, SSE and gRPC. Includes cloud, local and Git storage.
Inbox Zero is an open-source application designed as a personal AI assistant for email management. The tool aims to help users reach inbox zero quickly.
Novu is an open-source communication infrastructure for agents and products. It enables centralized management of notifications and multi-channel communication.
Basic Memory is an open-source tool enabling AI conversations to retain memory of previous exchanges. Avoids re-explaining context in each interaction.
NVIDIA NeMo is an open-source framework for building generative AI models: LLMs, multimodal, ASR, and TTS. Designed for researchers and developers, it provides a scalable foundation for training and deployment.
mlx-lm is a framework to run large language models with MLX, Apple's machine learning library for Silicon chips. Enables inference and fine-tuning on Mac.
Browser-use is an open-source framework enabling AI agents to interact with websites. It automates online tasks by giving models the ability to navigate, click, and fill forms.
LMCache is an optimized KV cache layer designed to accelerate LLM inference. The open-source GitHub project aims to reduce latency and memory consumption when processing long sequences.
AI-powered bug bounty tool leveraging Claude Code for reconnaissance, detection of 20 vulnerability classes, autonomous hunting, and report generation from terminal.
Open Dungeon is a local roleplay game using Gemma 4 QAT (12B) via Ollama for narration and FLUX for image generation. Runs on 7.7GB RAM with full 256K context, no APIs or cloud. Features Do/Say/Story modes, line editing, model selection. MIT licensed, source available.
User runs Qwen 3.6 27B with Openclaw on RTX 5070 Ti (16 GB VRAM). Switched from Qwen 35B due to tool-calling issues. Uses 4-bit quantized model with llama-server, memory optimizations (kv-unified, kv-offload, mlock). 2 hours stable testing, accessed via Telegram.
OpenAI now lets Codex users choose when to reset their quota, addressing frustrations caused by automatic resets occurring at inconvenient times.
ContextSpy is an open-source profiling tool that analyzes context usage in LLM applications. Operating as a local proxy, it records requests and breaks down token allocation (system prompt, tool definitions, conversation history) to identify optimization opportunities, similar to CPU/memory profilers.
SupraLabs releases Supra-Title-350M, a specialized 350M-parameter model for generating conversation titles. Built on LFM2.5-350M, available in GGUF format (177–711 MB), requires no system prompt. Experimental release before preference optimization.
Anthropic releases a study on AI's impact on employment, showing that skilled and digital-intensive jobs are particularly threatened, contradicting previous assumptions.
Anthropic is throttling its new Mythos model for certain tasks while building apps that directly compete with its largest customers. Partners, customers, and investors are pushing back against this platform strategy reminiscent of Microsoft's approach.
Prometheus, Jeff Bezos's startup, raises $12 billion with a $41 billion valuation to develop its engineering AI.
Kimi K2.7-Code, an agentic coding-focused model, improves long-horizon and complex software engineering tasks. Reduces thinking-token usage by ~30% versus K2.6.
Hands-on experience with MTP (Multi-Token Prediction) speculative decoding in llama.cpp. MTP assistants are not interchangeable: identical names and architectures don't guarantee same performance. Gemma 4 26B Q4: ~30 t/s → 55-62 t/s with correct assistant. Unquantized assistant models outperform Q4 versions (~10 t/s faster).
OpenAI acquires Ona (formerly Gitpod), a German startup founded in 2020 specializing in AI agents and secure cloud development environments. The acquisition aims to enhance Codex's capabilities for long-running autonomous coding tasks.