MiniMax introduces a new attention architecture (MSA) natively supporting 1M tokens without quadratic complexity. 'KV outer gather Q' approach delivers 4× faster than Flash-Sparse-Attention, compute reduced to 1/20th, 9× prefilling speedup, 15× decoding speedup. First open-weight model combining frontier coding, 1M context, and native multimodality.
Comparative study of learning rules (backprop, feedback alignment, predictive coding, STDP) via RSA alignment with human V1 fMRI. Backprop destroys 90% of V1 alignment after 1 epoch (r: 0.102→0.011), while PC and STDP lose only 25-31%. At epoch 40: PC/STDP >> BP/FA. Suggests fundamental trade-off between global error signals (higher layers) and early-layer alignment.
Mathematical primer on generative AI foundations by Tianhua Chen. Covers VAE, diffusion models, normalizing flows, autoregressive factorizations, GANs, Wasserstein GANs, and energy-based models through derivation-oriented approach.
CVE-Bench evaluates 5 frontier models on 20 real-world CVEs (Pillow, GitPython, urllib3, etc.) across 300 runs. Max solve rate 50% (60% under advisory). Agents patch syntactically but leave vulnerabilities open. Significant cross-family gaps (OpenAI vs Laguna, p<0.05), within-family noise. Failure modes: wrong-search drift, hallucinations, context loss.
Niels from Hugging Face announces paperswithcode.co, a revived SOTA tracking platform. New feature: indexing major conferences (NeurIPS, CVPR, ICML). CVPR 2026 papers indexed with arXiv IDs, categorized by task, tagged with GitHub, project pages, Hugging Face artifacts, and evals.
A user built a large-scale scraping pipeline aggregating 2M+ active job postings from 100,000+ company career sites. Dataset in Parquet format, daily-refreshed, freely accessible with standard fields (title, company, description, location, URL).
Discussion on AI voice model architecture: half-duplex (strict turn-taking, current standard) vs full-duplex (simultaneous two-way channels, like human conversation). Half-duplex systems cannot handle overlaps, backchannels ("mhm", "yeah"), or barge-in interruptions, explaining their robotic feel.
Free EU AI Act risk assessment tool: 10-question form, automatic risk tier classification, PDF report with applicable Articles. Creator plans monitoring SDK as Python library to document technical compliance requirements at inference time.
A LightGBM quantile regression model ranked a Bayesian target-encoded feature #1 by importance for watch price forecasting, but 4-seed × 3-variant ablation showed +0.28pp MAPE regression on hold-out. The learned signal was irreducible label noise (unobserved factors), failing to generalize.
Developer builds LIA, a persistent cognitive runtime around an LLM without behavioral prompts. Architecture includes 20k+ self-evaluated memories, cognitive kernel (LCRK v3), self-rule system, and private Linux domain. Control test: standard LLM in identical ecosystem remains inactive.
Discussion on fine-tuning small LLMs with annotated conversational data including reasoning traces and tool-calling decisions. Author proposes structuring data as samples with full history and loss masking on non-assistant tokens. Asks whether SFT is sufficient or if RL (PPO, GRPO, DPO) is needed to optimize tool use.
Real-time multilingual ASR system routing audio between specialized monolingual models (~100M parameters each) instead of one large model. Detects language switches via SpeechBrain and re-transcribes with correct model. Achieves 13% WER on inter-utterance code-switching, outperforming cloud APIs. Open-source repo released.
MLE-Bench shows 80% gains over two years, but new research (FML-Bench) reveals little comes from real algorithmic progress. At equal step budget and identical models, the two-year-old AIDE algorithm matches modern agent/evolutionary search systems. FML-Bench unifies code editing agents, step definitions, and val/test splits to benchmark algorithmic efficiency.
A developer built Chronos Engine, a tool that analyzes narrative inconsistencies by constructing causal graphs and detecting temporal paradoxes. The system identifies critical events, information loops with no origin, and generates stable alternative timelines.
Antitech offers free security assessments for AI agents and LLM-powered workflows. The company tests agents against prompt injection, tool abuse, data leakage, and guardrail bypasses. Participants receive vulnerability reports and future discounts.
Workshop on Unlearning and Model Editing (U&ME) at ECCV 2026. Platform to discuss techniques for modifying or removing specific knowledge from AI models without full retraining.
CVPR Workshop Radar aggregates CVPR 2026 workshops and tutorials into a searchable web interface. Search by title/organizer/topic, filter by date/type/program availability, personal schedule, timeline view. Automated pipeline: PDF extraction → scraping → LLM processing. Open source, offline-capable, no account required.
Developer open-sources AI accelerator on FPGA (AWS F2) based on RocketChip/RISC-V with attention mechanism built into silicon. Benchmarks: 225× speedup vanilla attention, 96× TinyBERT, 50× ViT, 30× GPT-2 prefill. Native BF16 support.
mlx-Chronos is an open-source CLI tool and community leaderboard to benchmark local LLM inference engines on Apple Silicon (oMLX, Rapid-MLX, mlx-lm, Ollama). Measures TTFT, throughput, RAM, and thermal state with standardized methodology. Currently populated only with M2 8GB results.
Researcher asks how to fine-tune an LLM for open-ended math problems (proofs). Standard SFT and RLHF inadequate; seeks appropriate method using MathNet dataset.
Two ML students question whether robotics faces a data scarcity problem. After normalizing public datasets, they suspect the real issue is interoperability: heterogeneous schemas, different sensors, incompatible coordinate frames. They ask robotics teams whether they would actually use data from other teams through a unified API.
Developer built NeuralDBG, a PyTorch debugger that automatically detects training failures (vanishing/exploding gradients, data anomalies). Key insight: failures are layer-localized, not global. Effective monitoring: gradient norm transitions per layer rather than raw histograms. Open-source tool available on PyPI.
Spiking neuron library optimized to fit in CPU cache. Benchmarked against PyTorch on Wikipedia dataset. Built with Gemini Flash 3.5.
Technical discussion on the theoretical validity of using LLM consensus to estimate probabilities for real-world events. Author questions the actual error independence between models trained on similar data and effectiveness on out-of-distribution events.
Optimized monokernel for LLM inference on AMD MI300X: 3,300 output tokens/s per request (batch 1, no speculative decoding). Architecture mapped to GPU physical topology. Initial support for 2B model, frontier MoE planned.
Research on probe-targeted fine-tuning (LoRA) for verbal confidence calibration in LLMs. Models internally detect correct answers (0.76–0.88 AUROC) but output 99% confidence uniformly. Fine-tuning across 8 models (7B–70B) with causal activation patching (ρ=0.976). Code and pre-registration available.
Call for papers for 2nd Workshop on Social Simulation with LLMs (Social Sim'26) @ COLM 2026. Theme: "Fidelity in Applications". Deadline June 23, 2026. Focus on evaluation, robustness, interpretability, and empirical validation of LLM-based simulated societies.
VeritasReason is an open-source Python framework adding structured reasoning and provenance layer to AI agents. It provides queryable context graphs, forward-chaining rule engine (YAML), W3C PROV-O provenance, and policy compliance checking. Works with OpenAI, Anthropic, Groq, Ollama.
AgingBench, a new longitudinal deployment benchmark, shows that swapping Claude Sonnet 4.6 for Opus 4.7 in the Claude Code CLI agent drops PyTest pass rate by ~15%. Memory policy alone drives a 4.5x spread in agent half-life across scenarios, larger than any model swap tested.
Wall-OSS-0.5 is a 4B VLA from X Square Robot with open training code. Zero-shot evaluation on 17 real-robot tasks: 4 tasks >80% progress, including Rope Tightening (82%). Post fine-tuning: 60.5% average task progress (+17.5pp vs pi0.5). Mixture-of-Transformers architecture with vision-aligned RVQ tokenizer and distributed DMuon optimizer.
Comparison of Reddit data collection options for ML projects. Official API (100 req/min, 500-comment truncation) inadequate. Pushshift defunct. Author recommends Sylvia: 480 free req/min, $0.0005/request thereafter, full recursive comment resolution, historical archive access.
Tomesphere: Chrome extension + website indexing 3M arxiv papers with LLM-curated summaries, OpenReview reviews, GitHub repos, HuggingFace models, citation graphs and SPECTER2 semantic neighbors. Free, no signup.
Tomesphere: Chrome extension + web layer enriching arxiv with LLM-curated TLDRs, OpenReview reviews, GitHub/HuggingFace links, citation graphs, SPECTER2 semantic neighbors. 3M papers indexed, free, no signup.
MONET, an Apache 2.0 dataset of 104.9M high-quality images with captions and metadata, released on Hugging Face. Built from 2.9B images and refined. Includes paper, UMAP visualization, text/image retrieval tool, and codebase for training T2I models.
Researcher trains Transformer-decoder models (100M–500M params) on 750M tokens of non-language series. Setup: AdamW, lr=1e-3, batch=4M tokens, 16 layers. Model fails to learn basic auto-regressive behavior and repeatedly generates single token.
Diffusion models applied to basketball trajectory simulation conditioned on partial sketches of player movements. The model jointly refines all player trajectories, producing more natural simulations than autoregressive generation. Code and model fully open-sourced.
Local BEAM 100K benchmark comparing Context Swarm Memory (CSM) to Hindsight. CSM scores 0.757573 AMB (342/400 correct) vs 0.733658 for Hindsight (326/400), using 38.2% fewer answer-visible context tokens. CSM slower: 29.23s vs 6.38s retrieval. Author seeks methodology feedback before official submission.
TritonMoE: pure Triton MoE kernel for portable NVIDIA/AMD inference without vendor-specific code. Fused gate+up GEMM reduces memory traffic by 35%. Achieves 89-131% of Megablocks throughput (batch ≤512 tokens) on A100, same kernel runs on MI300X. Limitations: degrades at 2048+ tokens and with 64+ experts.
Dataset of 5,000 synthetic QA pairs for fine-tuning UK GDPR compliance assistants. Each pair includes practical SME questions and answers with specific article references, ICO guidance, and actionable steps. Generated via Qwen 14B and DeepSeek API. MIT license, 1K sample on Hugging Face.
Developer applies N.E.A.T algorithm (NeuroEvolution of Augmenting Topologies) to train AI controlling worms in an in-development game. Each worm has a unique neural network evolving through natural selection, generating distinct behaviors.
Paper release on unified neural scaling laws in deep learning. Studies relationships between model size, training data, and performance. Reproducible results and benchmarks included.
A researcher conducted 1000+ experiments on AI agent self-improvement through harness modification for terminal bench tasks. Agents can propose meaningful one-time changes, but continuous self-improvement faces system-level challenges: determining which improvements can safely compound. Parallels noted with coding-agent customization patterns.
NVIDIA released SOL-ExecBench (235 production CUDA kernels). Top-ranked AI-generated kernels fail in real training: a fused embedding-gradient+RMSNorm backward kernel accumulates in bf16 instead of fp32, causing loss divergence masked by AdamW but visible with SGD.
PINN implementation in Python solving damped harmonic oscillator (2nd-order ODE) and 1D viscid Burgers' equation (nonlinear PDE). Covers forward and inverse problems, comparison with non-physics-informed baselines, extrapolation analysis, and statistical parameter estimation evaluation.
noisekit is an open-source CLI to generate annotated degraded speech datasets for realistic STT benchmarking (telecom G.711, ambient noise, reverb). Solves the gap: public datasets (FLEURS, CommonVoice) are too clean to evaluate production performance. HuggingFace AudioFolder compatible, includes PESQ/SNR/NISQA metrics.
NeuroFlow is a dynamic routing framework for Vision Transformer video inference. It exploits temporal redundancy via Exponential Moving Average (EMA) of patch-level embeddings to eliminate stationary tokens. Architecture B achieves 55.80× wall-clock speedup (678 ms → 11.9 ms on SigLIP 1792p) at 97.37% embedding fidelity. Code released.
Cross-species comparison of learning rules (BP, PC, STDP, FA) tested on human fMRI and macaque electrophysiology (V1/V2/V4/IT). STDP and PC dominate V1/V2 (ρ ≈ 0.30/0.28), conserving human pattern. In IT, alignment depends on model capacity (ResNet-50: ρ ≈ 0.25) rather than learning rule. Code and two papers (arxiv 2604.16875, 2605.22401) available.
PyTorch profiling technique using CUDA events to measure performance without GPU synchronization overhead. Lightweight alternative to torch.cuda.synchronize() and heavy tools (PyTorch Profiler, Nsight) for diagnosing training bottlenecks.
Open-source 7MB self-driving AI model trained on visual and sensor data. Real-time execution on phones and embedded devices without server infrastructure. Learns navigation, lane following, and drift recovery.
EAMS (Equivariant Anatomical Mesh Segmentor) applies rotational equivariance to mesh networks for 3D anatomical segmentation. The model (<2M parameters) maintains performance under geometric perturbations (40° rotation) where existing methods drop 25-26 IoU points. Evaluated on 4 clinical tasks (intracranial aneurysm, intraoral segmentation, liver).