Qwen is a family of open-weight language models developed by Alibaba Cloud, spanning text, code, and multimodal tasks. For example, Qwen2.5-72B is a 72-billion-parameter model freely available on Hugging Face.
Since June 2026, European digital authorities using Qwen or DeepSeek must comply with the AI Act requiring disclosure of training data. Beijing refuses to share them, creating a major regulatory conflict between the EU and Chinese providers.
Coding benchmark comparing Step 3.7, Qwen 3.5 122B-A10B, Qwen 3.6 27B, and Qwen 3.6 35B-A3B. Raw results presented without detailed methodology in excerpt.
2-week trial: replaced Claude with Qwen3.6-27B (Q6_K, 22GB) in multi-agent orchestrator on RTX 3090. Wins: plan generation (95% valid), memory extraction, auto-review. Failures: tool-call reliability 12% error rate vs 0.5% Claude, context drift >14k tokens, weak cascade-failure handling.
Qwen 3.6-35B-A3B achieves 977 tokens/s prompt processing and 262k context window on Intel Arc B70 Pro via llama.cpp with SYCL backend. User reports stable, usable local inference for complex tasks including game generation.
SENSE improves retrieval-based speculative decoding by anchoring retrieval on target model hidden states for robust semantic alignment. A soft-gated evaluation module validates semantic equivalence rather than surface forms. On LLaMA and Qwen, SENSE achieves 4.09 mean acceptance length and 3.26x speedup.
ProtStructQA is an executable benchmark for protein structural question answering. 382.2K questions generated from hidden domain-specific language, evaluated on Qwen3 (0.6B–8B) and Gemma-3. Key finding: capability threshold between Qwen3-1.7B and 4B where models transition from failing to produce executable denotations to mastering chain-of-thought reasoning.
SelSkill, a dual-granularity preference-learning framework, optimizes selective skill invocation in agentic tasks. On ALFWorld with Qwen3-8B: +10.9 pp task success, +29.1 pp execution precision. On BFCL: +5.7 pp task success, +29.5 pp execution precision. Zero-shot transfer to Tau-bench and PopQA.
Preference Delta Aggregation (PDA) aggregates weak preference signals from model pairs (e.g., Qwen3 4B vs 1.7B) via LoRA merging. Geometric Alignment Merging (GAM) aligns adapter subspaces before aggregation. On knowledge reasoning and agentic search benchmarks, PDA+GAM improves Qwen3 8B by +6.8 and +7.3 points respectively.
MiniCPM5 1B is a new compact language model from OpenBMB. Unlike MiniCPM 4.6 (based on Qwen 3.5 0.8B), it appears to be built from scratch with its own tokenizer and no vision capabilities. Users report different behavior patterns compared to other small models.
User compares Qwen 3.6 27B (8-bit, running locally) to Gemini Pro for research and advisory tasks. Qwen outperforms Gemini on deep dives (career, immigration, official documentation), while Gemini hallucinates and fixates on prior messages. Performance improved after MTP support in llama.cpp.
Qwen3.7-Plus introduces multimodal capabilities for AI agents. The model processes text, image, and video in a unified architecture designed for autonomous agent tasks.
Comparative benchmark of MTP (Multi-Token Prediction) quantizations between unsloth and bartowski on Qwen 3.5-4B, 3.5-9B, and 3.6-27B. Bartowski uses Q8_0 for MTP head (larger files). Tests for Snapdragon with Q4_0, IQ4_NL, Q4_1, MXFP4_MOE, Q8_0 limited to 24GB VRAM RTX 3090. Unsloth generally faster in decoding throughput and VRAM efficient.
Qwen 3.7 Plus from Alibaba is now available on Vercel AI Gateway. This multimodal model unifies vision and language for AI agents, covering GUI/CLI, coding, and visual tasks. Access via SDK with transparent pricing and zero platform fees.
Theoretical paper defining pairwise reference alignment as an ordinal observable for language model evaluation. Formulates statistical framework to measure whether a model ranks preferred responses above rejected responses, with finite-sample estimators and concentration bounds. Empirical validation on Qwen2.5 and RewardBench.
PhyDrawGen is a neuro-symbolic pipeline generating physics diagrams from text while respecting physical laws. An LLM extracts a typed scene graph, a deterministic solver converts it to a planar straight-line graph, and Qwen-VL fine-tunes a propose-verify loop. Evaluated on 1,449 problems (mechanics, optics, electromagnetism), it outperforms GPT-5-image and Gemini.
DecomposeR, a deep research framework, trains Qwen3-8B in two RL stages: planner RL learns typed DAG structures and query decomposition, then answerer RL learns branch execution and synthesis. Achieves 5.1-8.0 point improvements on long-form benchmarks through explicit planning and structured rewards.
Study of black-box LLM distillation through bounded behavioral indistinguishability. Authors evaluate Qwen and Llama pairs with 5,000-prompt suite, showing LoRA improves semantic similarity (0.788→0.862 for Qwen, 0.814→0.874 for Llama) but leaves detectable behavioral differences exploitable by adversaries.
Developer built an MCP server enabling LLMs to explore the Mandelbrot set with rendering tools, presets for interesting regions (Seahorse Valley, Elephant Valley), inspection tools for iteration counts and viewport settings, color palette selection, and HTML gallery generation. Tested with Qwen 3.6-35B. GitHub: openmandel.
A r/LocalLLaMA user recommends investing in GPUs rather than using workarounds for limited VRAM. He reports running Qwen 3.6-27B in Q8 with f16 K/V cache on 2×used RTX 3090s, achieving 128k context length (1399 pp, 104 tg).
Benchmark on 9070XT GPU: Qwen 35B A3B MTP achieves 43.74 T/s vs 38.07 T/s standard mode. MTP shows ~15% throughput gain despite multi-token prediction overhead. Identical test conditions (prompt, 8192 context, Q4_K_XL quantization).
Benchmark on Radeon 7900 XTX: Qwen3.6-35B vs Gemma4-26B with reasoning enabled. Qwen generates 2x more tokens (14,811 vs 7,386) but Gemma is ~20% faster end-to-end (95.6s vs 118.8s). Qwen's MTP reaches 130 tok/s vs 78 tok/s, but token count becomes the bottleneck. Quality close, interesting per-task splits.
A user shares a Tampermonkey script to add a reasoning toggle button in llama.cpp web chat for Qwen 3.6. The script intercepts API requests and controls the enable_thinking parameter without recompiling the source code daily.
llama.cpp benchmark comparing Windows 11 and Linux (Ubuntu 26.04) on Nvidia GPU (RTX 5080 + 2× RTX 5060 Ti). No significant performance difference: Qwen 3.5 122B achieves PP 300/TG 28 (Windows) vs PP 290/TG 28.5 (Linux); Qwen 3.5 397B: PP 140/TG 16 vs PP 150/TG 15.2. Tests repeated 4 times with recent llama.cpp including VRAM optimization.
Mudler releases APEX GGUF quantizations of Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled with bundled MTP (multi-token prediction) head. Files enable self-speculative decoding via llama.cpp without separate draft model. Size +2.5% vs non-MTP version, MTP head quantized Q8_0 for high draft accuracy.
User showcases personal data center: 4 systems (Threadripper 3960X + 4×3090 Ti, Xeon 8352 + 4×5070 Ti, Intel 14700K + 5090, Ryzen 5950X + 2×5070 Ti). Runs Qwen 27B for coding, Nemotron for STT, trains TTS LoRA. Agentic systems work overnight on repos with zero token cost.
Benchmark of inference engines on M1 Max 64GB comparing rapid-mlx, omlx, mlx-lm, and ollama with Qwen 3.5-4B. Rapid-mlx leads on speed and memory efficiency. Results submitted to mlx-chronos community leaderboard.
TCO analysis of a $6.4k local LLM server with 4x MI100 32GB GPUs and EPYC 48-core CPU. Runs 4 llama.cpp instances with Qwen 3.6 27B on ROCm. Processes 20.4M input tokens and 1.32M output tokens daily. Equivalent API cost: $3,701/year ($308/month). Author emphasizes proper hardware depreciation accounting for realistic TCO.
User reports successful execution of Qwen 3.6 35B MoE on M1 Max with Zoo Code. MoE model running locally, offline, on battery power.
A r/LocalLLaMA user built an autonomous agent with Qwen 3.5 27B enhanced by short/long-term memory (memory.md file, daily summaries, self-reflections). The agent handles complex tasks (app creation, web search, software installation). User prefers this local setup over GPT/Gemini for UX despite lower raw capability.
NVIDIA quantized Alibaba's Qwen3.6-35B-A3B model to NVFP4 (4-bit) using Model Optimizer. Weight reduction from 16 to 4 bits per parameter cuts GPU memory and disk size by ~3.06x. Benchmark results show minimal accuracy loss: MMLU Pro 85.6→85.0, GPQA Diamond 84.9→84.8.
User reports 125 tokens/s with Qwen 3.6 Q4 quantized on 2x RTX 4060 Ti (~$1000, 32GB VRAM). Outperforms high-end 2026 mini-PCs at fraction of cost. Testing CUDA 13.3 optimization to reach 150 tok/s.
Gryphe releases Pantheon-Reasoning-27B, an uncensored Qwen 3.6 27B model fine-tuned on roleplay data with full reasoning traces. Trained on Pantheon corpus (~28%), Claude Opus 4.6 reasoning traces (~21%), WorldSim narrative data (~16%), and text adventure content (~16%), the model experiments whether reasoning improves roleplay quality. GGUF quantizations available.
MTP (Multi-Token Prediction) benchmark on Gemma 4 31B and Qwen 3.6 27B using vLLM and llama.cpp. Result: 3.34x speedup (132.52 vs 39.69 tok/s). vLLM outperforms llama.cpp on Gemma 4; llama.cpp solid on Qwen. No confirmed quality degradation, VRAM overhead negligible.
User releases a Qwen 3.6 27B fine-tune after 2 years of experience. Model achieves 75% human alignment (+2% vs previous Qwen 3.5) through dataset expansion techniques. Evaluated on custom benchmarks.
Benchmark of Qwen3.6-27B quantizations on HuggingFace (unsloth, mradermacher, IQ4_XS, Ununnilium) from Q8 to Q2. Measured via llama.cpp: KL Divergence and Same Top P Percentage vs BF16 baseline. 8192 token context, KV cache q8_0. Q6-Q8 nearly lossless.
Alibaba distilled Claude Opus 4.8 into Qwen models. Knowledge distillation transfers capabilities from large models to smaller, more efficient versions.
Gemma 2 26B A4B impresses on M5 MacBook: high speed, versatility (creative writing, debugging, vision), conversational personality. Versus Qwen 3.6 35B, Gemma excels outside coding despite slight weakness in programming tasks.
A developer experiments with HTML as the primary chat language for coding agents instead of markdown. By switching the system prompt to HTML, the agent (Qwen 3.6-27B) now generates SVG diagrams directly in responses. Results are promising but the model still tends to default to markdown.
DenseSteer is a training-free inference-time steering method that enhances mathematical reasoning in small models (≤3B parameters) by modulating internal representations toward dense reasoning patterns. On Qwen-2.5, the approach shows that more proficient reasoning uses fewer steps but higher information density per step.
Comprehensive evaluation of 14 open-source safety guard models on 79,331 samples across 8 NIST AI Risk Framework categories. Qwen Guard (4B) achieves highest recall (83.97%), outperforming Llama Guard (12B) and GPT-OSS Safeguard (20B). Model size does not correlate with safety detection performance.