Pattern Matching Mechanics: High vector proximity between Query (prompt target) and Key vectors generates sharp softmax attention weights, enabling deterministic pattern deduction.
2D Token Embedding Space
Drag Q/K vector tokens
Q-K Softmax Heatmap
Normalized Weights
Next-Token Logit Distribution & Completion Stream
Calculated probability distribution based on softmax temperature scaling.
Sequence Continuation Output: