Archives

June 2026

2731 articles

arXiv cs.AI·

Where Instruction Hierarchy Breaks: Diagnosing and Repairing Failures in Reasoning Language Models

Diagnostic study of instruction hierarchy failures in reasoning models (Gemma-4-31B-IT, Qwen3.6-35B-A3B, Claude Sonnet 4.6). White-box framework localizes failures into instruction identification, conflict resolution, and response realization. Two training-free self-monitoring mechanisms reduce rule-following non-compliance by 81-99% across models.

ReasoningAI safetyAlignment
SIG
72
HYP
25
arXiv cs.AI·

Reconstructing and forecasting disease trajectories of patients with Alzheimer's disease using routine data in resource-constrained settings

GNOVA, a framework combining GRU, Neural ODE, and VAE, predicts cognitive trajectories (CDR-SB, MMSE) in 1,727 Alzheimer patients (ADNI, 10 years) without neuroimaging. MAE of 1.35 and 2.28 respectively. Enables interpolation/extrapolation and calibrated uncertainty estimation for resource-constrained settings.

ReasoningBenchmarksPapers
SIG
72
HYP
18
arXiv cs.AI·

Automatic Extraction of Structured Information from Brain MRI Reports Using an Open-Weight Large Language Model

Study on automatic extraction of structured data from Dutch brain MRI reports. LLaMA 3.1 achieves 90-96% accuracy for visual rating scores (medial temporal atrophy, global cortical atrophy, Fazekas), 93% for microbleed detection, but 66-80% for numerical variables. Few-shot prompting improves numerical performance (92% for microbleeds).

LlamaPrompt engineeringEvals
SIG
72
HYP
15
arXiv cs.AI·

A case study of evaluating AI agents on a neuroscience data-to-discovery pipeline

Empirical study of general-purpose coding agents on a fly optogenetics data-to-discovery pipeline. Agents solve individual stages but fail end-to-end: lack of predefined iteration criteria, weak scientific judgment, poor visual interpretation. Challenges absent from existing benchmarks: computational resource management, generalization to large held-out datasets.

AI AgentsCode generationEvals
SIG
72
HYP
18
Reddit r/LocalLLaMA·

2X tk/s (from 19.4 -> 38.1 tk/s on 1 x MI50) Playing with a hypothesis like speculative decoding.. but instead of an additional side model, exploiting that I can run multiple computations side-by-side AS IF I had Qwen3.6-27B loaded twice in memory - small quants don't use all the available compute.

Speculative decoding optimization: 2x throughput increase (19.4 → 38.1 tk/s on MI50) by running multiple parallel computations with the same Q8 quantized model, exploiting that small quantizations use only 25% of available compute.

Open source
SIG
65
HYP
25
Reddit r/LocalLLaMA·

I bundled a fully local LLM inside my Unity game. No internet, no cloud, no API key. The conversation is the gameplay.

A developer embedded a local LLM into their Unity game 'Simulation Simulator' with no internet or API required. Gameplay is driven by natural conversations with an AI that generates 5 different endings based on player interactions. The game explores simulation theory and philosophy through organic, unscripted dialogue.

LlamaCode generationAI Agents
SIG
65
HYP
45
Reddit r/MachineLearning·

LLM Relational Intelligence: A 4-Month Research Experiment on Multi-Model Behavioral Alignment with Human Communication [R]

4-month experiment testing whether context windows can be engineered so frontier models (GPT, Claude, Gemini, Grok) interact indistinguishably from human-to-human interaction. Gemini demonstrates highest relational intelligence. Author treats context window as behavioral environment rather than query interface, using modeling, accountability, humor, and social correction.

Prompt engineeringGPTClaude
SIG
35
HYP
65
Reddit r/LocalLLaMA·

Used local Ollama (gemma4:e4b + nomic-embed-text) to bulk-generate AI summaries for 4300 arXiv papers and push them to a remote Cloudflare DB — pipeline walkthrough

Developer built ArxivExplorer, semantic arXiv search engine with AI-generated summaries. Local pipeline uses Ollama: gemma4:e4b (8B) for structured JSON summaries, nomic-embed-text (137M) for 768-dim embeddings. 4300 papers processed, ~95% first-pass success rate, storage via Cloudflare D1/Vectorize. REST API 100× faster than wrangler.

RAGEmbeddingsOpen source
SIG
75
HYP
25
Reddit r/LocalLLaMA·

Been watching real adversarial input hit my detection API for six months. Here's what's actually landing.

Six months of real adversarial attacks against a prompt injection detection API (Bordair). Three dominant patterns: multi-turn setups invisible in isolation, forward-momentum exploitation, and role redefinition leveraging model helpfulness. Single-message classifiers consistently fail. Stateful defenses recommended over classifier-only approaches.

Prompt engineeringAI safetyAI Agents
SIG
72
HYP
28
GitHub Trending·

<svg aria-hidden="true" data-component="Octicon" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-repo mr-1 tmp-mr-1 color-fg-muted"> <path d="M2 2.5A2.5 2.5 0 0 1 4.5 0h8.75a.75.75 0 0 1 .75.75v12.5a.75.75 0 0 1-.75.75h-2.5a.75.75 0 0 1 0-1.5h1.75v-2h-8a1 1 0 0 0-.714 1.7.75.75 0 1 1-1.072 1.05A2.495 2.495 0 0 1 2 11.5Zm10.5-1h-8a1 1 0 0 0-1 1v6.708A2.486 2.486 0 0 1 4.5 9h8ZM5 12.25a.25.25 0 0 1 .25-.25h3.5a.25.25 0 0 1 .25.25v3.25a.25.25 0 0 1-.4.2l-1.45-1.087a.249.249 0 0 0-.3 0L5.4 15.7a.25.25 0 0 1-.4-.2Z"></path> </svg> <span data-view-component="true" class="text-normal"> Andyyyy64 /</span> whichllm

Open-source tool to find the best-performing local LLM for your hardware. Ranked by real, recency-aware benchmarks rather than parameter count. Single command to test instantly.

Open sourceBenchmarksTools
SIG
65
HYP
35