Framework for processing long documents via parallel chunking and evidence-anchored consolidation. Reduces omission error by 84%, increases evidence traceability by 130%, decreases unsupported claims by 91%. Smaller models benefit most.
Repeating a smaller dataset during training accelerates learning compared to using a larger dataset, via sampling biases that enable favorable layer-wise growth. Effect observed across algorithmic tasks, architectures and optimizers. Authors provide theoretical analysis and empirical interventions.
New approach for node classification in partially labeled graphs. Authors propose Transductive Sharpening (TS), a loss-level modification that minimizes prediction entropy on unlabeled nodes while counterbalancing effects on labeled nodes. Consistent improvements across multiple benchmarks without architectural changes.
Neural framework to estimate pairwise conditional mutual information directly from hidden states of masked diffusion models (MDMs). The estimator captures the model's internal dependency structure and enables MI-guided parallel decoding, reducing inference forward passes by 3-5x on Sudoku and protein sequence generation (ESM-C) while preserving quality.
GRAM (Generative Recursive reAsoning Models) extends recursive reasoning models by replacing deterministic latent trajectories with probabilistic multi-trajectory computation. Trained with amortized variational inference, GRAM outperforms recurrent and recursive baselines on structured reasoning and multi-solution constraint satisfaction tasks.
SELFCI is a complementary self-distillation framework optimizing two independent reverse KL divergences to align LLMs with Contextual Integrity (CI). The system preserves task-relevant information while minimizing inappropriate disclosures, without costly external supervision, outperforming GRPO and other baselines.
Study on collocational bootstrapping: mechanism where regularities in word co-occurrence patterns provide cues to syntactic dependencies. Neural networks trained on synthetic datasets varying in subject-verb pairing predictability. Results suggest this mechanism could explain subject-verb agreement acquisition in children.
Stage-Audit detects hallucinations in LLM-curated tables by enforcing curator-auditor separation and row-level source verification. On 51 Seed2Frontier instances, precision improves from 0.356 to 0.505 (+42%) and F1 from 0.334 to 0.451 (+35%), with explicit per-row source traceability.
Study on generating long-form literary reviews based on Torrance Test of Creative Writing (TTCW). Dataset of 263,911 stories annotated across 14 creativity dimensions. Fine-tuning Qwen3 (4B and 8B) shows non-reasoning supervision achieves better performance (0.6820), while reasoning-supervised models fail to complete the required 14-metric review format.
LFD (LLM-assisted Feature Discovery) method generates interpretable text representations via inter-annotator agreement (Cohen's κ) and label disentanglement. Validated on 10 text classification tasks: features clearer and less label-entangled than bottleneck baseline, confirmed by human audit (232 raters).
ProxyCoT, a chain-of-thought fine-tuning method, improves reasoning on long contexts (up to 10M tokens) by transferring reasoning capabilities from short proxy contexts to full contexts via RL/distillation then supervised fine-tuning. Performance gains with reduced computational overhead and cross-domain generalization.
Plug-and-play framework to convert Transformer nonlinear operators into spiking neural network (SNN) compatible operations. Decomposes Softmax, SiLU, and normalization into primitives (division, exponentiation, L2 norms) executable by LIF neuron groups without fine-tuning. <1% accuracy drop on LLM benchmarks.
Novel predictive coding approach via hierarchical Gaussian filters. Authors restore precision-weighted message passing, enabling simultaneous learning of activations, weights, and precisions without global error signals. On FashionMNIST, the method converges faster than backpropagation while retaining biological advantages of predictive coding.
DEL (Digit Entropy Loss) is a novel loss function to improve numerical prediction in LLMs. Tested on CodeLlama, Mistral, DeepSeek, and Qwen-2.5 across 7 mathematical reasoning benchmarks, it outperforms existing methods (MLE, Number Token Loss) by optimizing digit entropy in a supervised manner and generalizing to floating-point numbers.
Theoretical work on piecewise-stationary low-rank linear contextual bandits with drifting subspaces. Introduces SPSC algorithm combining isotropic probes with windowed projected ridge-UCB, achieving dynamic regret Õ(r√T) instead of Õ(d√T). Characterizes identification boundary for moving subspace recovery and validates on 11 benchmarks (synthetic, MovieLens, clinical, ZOZOTOWN production logs).
arXiv study shows LLMs over-idealize experiences of people with disabilities in social media content generation, producing unrealistic positive stereotypes. Comparative analysis reveals negative bias: certain topics (career, entertainment) overrepresented for nondisabled individuals, reinforcing exclusionary narratives.
Study on inductive biases in neural morphological generation. Analysis of Japanese past-tense verb inflection reveals a rare irregular subclass (<1% of data) accounts for disproportionate error concentration. Controlled ablations show removing this subclass improves generalization more than eliminating all irregular verbs.
Study of synchronization in full-duplex dialogue models (Moshi) that listen and speak simultaneously. Researchers measure internal representation alignment via CKA and detect anticipatory turn-taking cues. Synchronization is strong without noise, degrades with noise, and internal states encode predictive information for turn-taking.
Counter Turing Test evaluates AI-generated text detection techniques. Task A (binary classification) achieves F1=1.0 to distinguish human vs AI text. Task B (model attribution) reaches 0.9531 for identifying GPT-4, Claude 3.5, Llama. Top approaches combine DeBERTa, BART, fine-tuning, and ensemble learning.
CNN encoder-decoder framework predicts pore-scale velocity fields in porous media directly from geometry. Custom loss function enforces velocity reconstruction, incompressibility, no-flow conditions, and physical constraints. Tested on out-of-distribution geometries and accelerates Lattice-Boltzmann simulations (90% of cases).
FBOS-RL introduces a feedback-driven bi-objective reinforcement learning framework to improve large-scale model training. The framework combines two mutually reinforcing objectives: Exploitation-oriented Policy Alignment (EPA) and Exploration-oriented Capability Cultivation (ECC). Experiments show FBOS-RL converges faster than GRPO with higher performance ceilings.
LLMs struggle to follow specialized conventions of gold-standard benchmarks. Authors propose an iterative moderation framework that reuses and refines annotation guidelines as an alignment mechanism. Testing on three biomedical NER tasks (NCBI Disease, BC5CDR, BioRED) with GPT, Gemini, DeepSeek confirms efficacy of guideline integration and reasoning-optimized models.
Two new self-supervised learning models for link prediction in graphs: L-GRACE and L-BGRL. Based on link representations instead of node representations, they incorporate structural augmentation grounded in community structure. Performance matches state-of-the-art in both supervised and self-supervised settings.
DPR-BAG generates abstracts for biomedical articles lacking summaries through structured decomposition (BOMRC schema), parallel LLM-based summarization, and refinement. On PMC-MAD (46,309 articles), improves abstractive novelty while maintaining factual consistency. Training-free, zero-shot framework.
WaveGraphNet is a coupled inverse-forward graph learning framework for guided-wave damage localization in CFRP plates. The model represents piezoelectric transducers as graph nodes and uses a forward branch as a physics-consistent regularizer to improve generalization to unseen regions of the structure.
GraphDiffMed presents a medication recommendation framework using dual-scale Differential Attention v2 with pharmacological constraints. Tested on MIMIC-III, the model filters noise at intra-visit and inter-visit levels while incorporating drug-drug interactions, outperforming baselines on recommendation quality and safety metrics.
ik_llama.cpp outperforms llama.cpp on MTP with RTX 4070 Super 12GB. Using Qwen3.6-35B-A3B-IQ4_XS, user achieves 110.24 tok/s average and 87.49% acceptance rate. Optimized configuration provided with specific cache and quantization parameters.
Railway, agent-native cloud platform, reaches 3M users with 100K signups/week. Own-metal infrastructure, $200K+ coding agent spend, elimination of traditional pull requests.
OpenAI claims a general-purpose reasoning model found a counterexample to Erdős's unit-distance conjecture in discrete geometry. The model constructed planar point sets with more than n^{1+δ} unit distances, disproving the conjectured upper bound. The proof was verified by an AI grading pipeline and reviewed by mathematicians.
Benchmark of 5 models (Opus 4.7, GPT-5, Sonnet 4.6, DeepSeek V4 Pro, Hunyuan Hy3) on 8 Python refactoring tasks with MCP. Quality gap <2% (96-99% first-attempt tool call success) but 10x cost difference: Opus $15, GPT-5 $11, Sonnet $4, DeepSeek <$2, Hunyuan $1.50.
Google AI Studio now generates native Android apps from prompts in Kotlin with Jetpack Compose, testable in a browser emulator. For simple utility apps like trackers and checklists, the Play Store could become less relevant. Apple blocks AI-generated apps.
Custom RL algorithm NOML for continuous 6-DoF flight control. Combines TD3 with anchor policy (fixed safe action), hierarchical actor (3 independent MLPs pitch→roll→rest), and mirror learning (left-right symmetry). Solves vanilla TD3 oscillation collapse. Open-sourced under Apache 2.0.
Google DeepMind integrates its Genie 3 world model with Street View data: users drop a pin on a map and explore an AI-generated world based on a real place. Street View becomes a strategic training resource for AI agents and robots.
Lance is an open lakehouse format for multimodal AI. Converts from Parquet in 2 lines of code with 100x faster random access, vector indexing, and data versioning. Compatible with Pandas, DuckDB, Polars, PyArrow, PyTorch.
Gemini 3.5 Flash costs 5.5x more than its predecessor in benchmark testing. On agent tasks, total costs exceed Gemini 3.1 Pro by 75% due to more interaction steps required. Google follows industry trend: AI models are becoming significantly pricier across Anthropic and OpenAI as well.
Grok Build 0.1, a beta coding model trained for agentic coding, is now available on Vercel AI Gateway. The model runs with non-configurable reasoning effort and no non-reasoning mode. Vercel AI Gateway provides a unified API for model calls, usage and cost tracking, with intelligent provider routing and automatic retries.
Guardrails improve an 8B model from 53% to 99% on agentic tasks, according to an ACM CAIS '26 preprint. The technique enhances control and reliability of AI agents.
Systematic review of 77 studies on LLM agents in financial trading. Only 19 studies meet minimum criteria (action output + closed-loop evaluation). Key finding: lack of comparable protocols, insufficient reproducibility (no R3 studies), and missing documentation on transaction costs and universe handling.
Multi-pedestrian safety warning system at urban intersections using a tightly coupled digital twin framework with camera and ultra-wideband sensors, trajectory prediction modeling. Deployed on COSMOS testbed in New York City, delivers real-time alerts via edge-cloud computing and significantly reduces response times for vulnerable road users.
Theoretical paper on efficient elicitation of collective disagreement among voters. Introduces the plurality matrix, a generalization of pairwise comparisons, to identify minimal aggregated preference information needed for disagreement measures. Shows that certain measures (rank-variance, divisiveness) require subset size 3, not just pairwise comparisons.