Attention Is All You Need • Interactive Architecture Explorer

Transformer Explorable: How Attention Powers Modern AI

Inspect self-attention matrices, query-key dot products, positional embeddings, and next-token distributions in real time.

Input Sentence or Sequence

Stage 3: Scaled Dot-Product & Attention Heatmap Shape: [B=1, Heads=8, S=10, d_k=64]