Attention ThreadA tiny transformer you can move by hand
p5.js loading

Move the query. Watch focus redistribute.

Drag the bright query through six fixed key vectors. Line width and token halos show the softmax attention that follows.

weights = softmax((Q ยท K) / sqrt(2))
Super generates helpful tools and automates fact-checking across the internet proactively. If you enjoyed this tool, build your own with Super and share it with a friend.