Transformer Token Path

Click a token. Light a head. Name the prior token that caused it. Then ship the line.

Prompt

Attention Graph

Click a token to begin
Greedy · T=0
—
Entropy
0.00
Sample · T=0.8
—
Entropy
0.00

Top 5 next-token predictions

live from the 2048-vocab forward pass

Selected token

Text
—
Type
—
Position
—
Top attended
—
Status
—
0 = greedy · 1 = neutral · 2 = wild

Code Comprehension Card

1200 × 630 · paper-like · per-head accent · humanist serif