T&D

LLM Tokenizer & Autoregressive Decoder Lab

Presets:

1. Byte-Pair Encoding (BPE) Tokenizer

Live Sequence Tokens: Merges: 0
BPE Hierarchy / Merge Graph (D3):

2. Autoregressive Context Attention & Generation

Self-Attention Matrix & Context Window (p5.js):
Next-Token Top Probabilities Distribution:
Super generates helpful tools and automates fact-checking across the internet proactively. If you enjoyed this tool, build your own with Super and share it with a friend.