Why Neural Networks Hallucinate — Mechanistic Simulator

Prompt Context Scenario

Context Grounding (RAG / Attn) 35%

Sampling Temperature (T) 0.80

Presets

AUTOREGRESSIVE TOKEN GENERATION

Hallucination Risk Medium

Softmax Entropy 1.42 nats

Grounding Confidence 35%

NEXT-TOKEN LOGIT PROBABILITIES P(w | context) Selected: token