Step Control & Parameters
Scale by √d_k (Scale factor = 2.0)
Editable Weight Matrix W_Q
Editable Weight Matrix W_K
Editable Weight Matrix W_V
Linear Algebra Matrices & Heatmaps
Status: Computed
Query Matrix (Q)
[2 x 4]
Key Matrix (K)
[2 x 4]
Value Matrix (V)
[2 x 4]
Attention Weights (S)
[2 x 2]
Contextual Output (O = S · V)
[2 x 4]
Step 1: Linear Projections
Calculating Q = X · W_Q...