Fine-tuning means retraining a pre-trained AI model on a specific dataset to adapt it to a precise task. For example, OpenAI fine-tuned GPT-4 to follow instructions more accurately in ChatGPT.
Developer seeks to build a free offline AI tutor grounded in a university textbook. Proposed architecture: RAG as core component (chunking, embedding, retrieval with page/section citations) + optional LoRA for pedagogical style. Questions on model selection (Qwen, Gemma), handling complex structures (figures, equations), and packaging for non-technical users.
Post-training quantization (PTQ) reduces reasoning model accuracy and increases chain-of-thought length. 52% of failures involve correct intermediate answers not output as final answers. A training-free logit penalty on overthinking markers ("wait", "but", "alternatively") reduces CoT length by 12-23% while preserving accuracy across 5 models (1.5B-32B) and 5 benchmarks.
CSRP, a three-stage framework for Chinese grammatical error correction, combines continual pre-training (5.9M samples), Chain-of-Thought fine-tuning, and policy optimization with efficiency-aware rewards. Achieves 50.99 F₀.₅ on NACGEC and outperforms GPT-4 on spelling correction (59.61 F1).
DLLM-JEPA pairs JEPA with masked-diffusion language models for self-supervised representation learning. Eliminates need for explicit multi-view data and reduces training FLOPs by 33% vs LLM-JEPA. Achieves +18.7pp improvement on GSM8K (LLaDA-8B) and +11.4pp (Dream-7B) while preserving base model capabilities.
Empirical study adapting Phi Silica for short-form text rewriting via dataset curation, prompt distillation, and parameter-efficient fine-tuning. Dataset built from public slide decks. Results: improved semantic fidelity, reduced hallucinations, higher preference win rate vs GPT-5-chat.
Theoretical and empirical study of parameter-based knowledge editing limits in LLMs. Authors prove via dimensional collapse hypothesis that localized modifications propagate global interference degrading model capabilities. Retrieval-based methods consistently outperform parameter-editing approaches.
Automatically Differentiable Nonlinear Tensor Networks (ADNTNs) compress neural network weights using compact core tensors trained via reverse-mode automatic differentiation. Tested on AlexNet and VGG-16, they achieve per-layer compression ratios from 2000× to 77000× while maintaining or improving accuracy.
Study on preventing catastrophic forgetting during continual pretraining of multilingual language models. Authors propose five parameter alignment strategies (layer freezing, regularization, post-hoc reversion, model merging) tested across 32 languages and four evaluation axes. Parameter alignment substantially reduces forgetting while maintaining language acquisition.
Researchers demonstrate that hidden reasoning traces in LLMs can be extracted via Reasoning Exposure Prompting (REP), a lightweight prompting method using shadow-model-generated demonstrations in auxiliary code-like formats. REP exposes internal traces even when deployed systems intentionally hide them, while preserving useful reasoning signals for distillation.
RAFT is a two-stage domain fine-tuning method that mitigates catastrophic forgetting. It refines data via self-conditioned rewriting and answer fusion, then applies on-policy distillation where the original model provides soft targets on student-generated trajectories. Across five domains, RAFT improves domain accuracy by 23.2% over standard SFT and recovers 18.2% of degradation on MS-Bench.
Study of temporal framing in news: a taxonomy of 8 temporal frames identifies how references to past, present, and future function as rhetorical devices. Annotated corpus of 458 English/German articles (2K+ sentences, 3K annotations). Supervised models substantially outperform zero-shot approaches for sentence-level temporal framing detection.
ARCA introduces a token-level credit assignment method for LLM reinforcement learning that addresses degeneracy of intrinsic signals (surprisal, entropy reduction, policy divergence) under LoRA. It measures adapter salience directly via L2 norm of hidden-state residuals instead of output-distribution shifts. Tested on MATH/Qwen3-1.7B with GRPO, ARCA avoids pathological weight concentration.
New quantization method preserving inner products with unseen vectors. Adaptive unbiased algorithms developed with theoretical guarantees. Practical implementations 2-10× faster than prior ASQ state-of-the-art while maintaining quality.
arXiv paper on temperature's role in LLM distillation. Authors show forward KL (FKL) outperforms reverse KL (RKL) at higher temperatures, contrary to prior empirical conclusions that omitted this parameter. Temperature enriches FKL with non-dominant token signals while merely rescaling RKL gradients.
BiGRU architecture enhanced with KAN (Kolmogorov-Arnold Network) block for legal document classification and summarization in low-resource multilingual setup. Evaluation on Bengali/English/transliterated corpus from Bangladesh: 67.96% accuracy in classification (F1=0.65), ROUGE-1/2/L scores of 0.38/0.23/0.31 in summarization. Ablation study shows KAN improves classification from 57.34% to 67.96%.
SALSA adapts speech-aware LLMs via layer-wise learned steering vectors optimized with supervised objectives. Tested on children's speech, multilingual, and Mandarin-English code-switching, it achieves up to 46.8% relative improvement over zero-shot. Steering the encoder's later layers outperforms steering the LLM backbone.
UniKE, the first benchmark for cross-modality knowledge editing in unified multimodal models (UMMs), reveals a critical gap: text-side efficacy reaches 92% but VQA accuracy in image generation drops to 18.5%. A reasoning-augmented parameter editing method improves results by up to +18.6 percentage points.
Preference Delta Aggregation (PDA) aggregates weak preference signals from model pairs (e.g., Qwen3 4B vs 1.7B) via LoRA merging. Geometric Alignment Merging (GAM) aligns adapter subspaces before aggregation. On knowledge reasoning and agentic search benchmarks, PDA+GAM improves Qwen3 8B by +6.8 and +7.3 points respectively.
FoLoRA, a forgetting-aware optimization framework, adapts foundation models via generalized Rayleigh quotient. It balances target task performance and preservation of pretraining capabilities by penalizing adaptation directions with low utility relative to forgetting. Tested on math, code, and instruction-following adaptation.
A LightGBM quantile regression model ranked a Bayesian target-encoded feature #1 by importance for watch price forecasting, but 4-seed × 3-variant ablation showed +0.28pp MAPE regression on hold-out. The learned signal was irreducible label noise (unobserved factors), failing to generalize.
Discussion on fine-tuning small LLMs with annotated conversational data including reasoning traces and tool-calling decisions. Author proposes structuring data as samples with full history and loss masking on non-assistant tokens. Asks whether SFT is sufficient or if RL (PPO, GRPO, DPO) is needed to optimize tool use.
arXiv paper on autonomous agentic data engineering for model specialization. GPT-5.2 constructs a training curriculum improving a student model by 57.29% through iterative, agent-driven data adaptation. Formalizes a novel task evaluating LLMs as autonomous data engineers.
ImmigrationQA: source-grounded QA dataset of 17,058 pairs across 13 U.S. immigration law subdomains. Fine-tuned Llama 3.2 3B with LoRA on corpus of 10,056 validated documents. Fine-tuned model: 1.08/3.0 (16.8% fully correct) vs Llama 3 8B base: 0.85/3.0 (4% fully correct), 27% relative improvement. Cost: ~$29. Dataset, model, and code publicly released.
Method to automatically generate fine-grained evaluation rubrics without human annotation, tested on four benchmarks. Training-free approach, then iterative fine-tuning via meta-judge reward signals. A fine-tuned 14B rubric generator outperforms larger proprietary models.
Method to detect and classify dataset usage in research literature using a multitask GLiNER framework. Combines dataset mention extraction, relation identification, and usage-context classification. Leverages synthetic data generation and LLM-based revalidation to address label scarcity.
New post-training method for reasoning models: Feedback Distillation trains the model to match its own distribution conditioned on LLM-generated feedback at token level. Tested on Lean4 theorem-proving, it maintains greater trajectory diversity than GRPO, improves policy entropy and pass@k scaling. Combined with GRPO, it outperforms either method alone.
Study on long-term effects of data selection during multi-stage LLM fine-tuning. Authors show that short-term optimal strategies (loss-based, gradient-based, diversity-based) can slow future learning and increase catastrophic forgetting. They propose LHAS (Long-Horizon Aware Selection) to evaluate selection as a global training intervention.
Unicorn, a multi-dataset pretraining framework, bridges the trade-off between channel-independent models (scalable but ignoring dependencies) and channel-dependent models (expressive but dimension-bounded). Using a latent prototype codebook, it projects heterogeneous channels into a shared space to learn identity-agnostic, reusable correlation patterns transferable across domains.
Study of black-box LLM distillation through bounded behavioral indistinguishability. Authors evaluate Qwen and Llama pairs with 5,000-prompt suite, showing LoRA improves semantic similarity (0.788→0.862 for Qwen, 0.814→0.874 for Llama) but leaves detectable behavioral differences exploitable by adversaries.
5WBENCH, a balanced 5,000-sample benchmark across 5W categories, reveals unlearning methods fail on causal (Why) questions. MAAT, a three-phase framework operating on LoRA weights, combines gradient-projected ascent, SVD rank pruning, and KL-hidden-state repair to simultaneously achieve high forgetting and retention on causal knowledge.
A researcher built Mamba-Titan-1.4B-Reasoning (2.54B params MoE) on RTX 3060 by freezing a 1.4B Mamba-1 backbone and adding 8 trainable experts. Trained on DeepSeek CoT traces, the model developed a 'vault door' mechanism: the </think> token isolates at the smallest norm (1.991 vs 4.742 mean) to control latent reasoning termination.
Workshop on Unlearning and Model Editing (U&ME) at ECCV 2026. Platform to discuss techniques for modifying or removing specific knowledge from AI models without full retraining.
User trained GPT-1 on RTX 2060 Super (8 GB VRAM) in ~1 hour using Claude-generated code based on original implementation. Cost to reproduce GPT models dropped 500–1000× since GPT-2 ($43,000 → $48 per H100 cluster run).
Kaikaku.AI releases Epicure, three AI models separating ingredients by recipe compatibility or chemical similarity. Trained on 4.14 million multilingual recipes and FlavorDB, they generate different recommendations per source. The chemistry-only model outperforms recipe-based variants on taste and nutrition classification without direct data.
Developer built an ebook reader with embedded translation model based on llama.cpp. Local application for multilingual readers: AI translation, sticky notes, bookmarks, reviews, searchable annotations. Uses compact models (4B-70B) without cloud dependency.
User showcases personal data center: 4 systems (Threadripper 3960X + 4×3090 Ti, Xeon 8352 + 4×5070 Ti, Intel 14700K + 5090, Ryzen 5950X + 2×5070 Ti). Runs Qwen 27B for coding, Nemotron for STT, trains TTS LoRA. Agentic systems work overnight on repos with zero token cost.
NVIDIA quantized Alibaba's Qwen3.6-35B-A3B model to NVFP4 (4-bit) using Model Optimizer. Weight reduction from 16 to 4 bits per parameter cuts GPU memory and disk size by ~3.06x. Benchmark results show minimal accuracy loss: MMLU Pro 85.6→85.0, GPQA Diamond 84.9→84.8.
Researcher asks how to fine-tune an LLM for open-ended math problems (proofs). Standard SFT and RLHF inadequate; seeks appropriate method using MathNet dataset.
Straightforward method to train an LLM from scratch: data download, preprocessing, and text generation. GitHub repo with executable code.
Gryphe releases Pantheon-Reasoning-27B, an uncensored Qwen 3.6 27B model fine-tuned on roleplay data with full reasoning traces. Trained on Pantheon corpus (~28%), Claude Opus 4.6 reasoning traces (~21%), WorldSim narrative data (~16%), and text adventure content (~16%), the model experiments whether reasoning improves roleplay quality. GGUF quantizations available.