ATTENTION VECTOR LAB
Loading D3...

Make attention math visible.

Transformer attention begins with a geometric question: which key points most strongly with this query? Predict first, then inspect every number.

Drag the blue query or use the worked aim

q = (0.20, -0.70)
Arrow keys move q by 0.05
The worked query is q=(0.80,0.60). Vector length and angle both change the dot product.

Predict before revealing

scale = sqrt(2)

Which key will receive the largest weight?

Choose a predicted key, then shape the query vector.

Super generates helpful tools and automates fact-checking across the internet proactively. If you enjoyed this tool, build your own with Super and share it with a friend.