T&D

LLM Tokenizer & Autoregressive Decoder Lab

Presets:

1. Byte-Pair Encoding (BPE) Tokenizer

Live Sequence Tokens: Merges: 0
BPE Hierarchy / Merge Graph (D3):

2. Autoregressive Context Attention & Generation

Self-Attention Matrix & Context Window (p5.js):
Next-Token Top Probabilities Distribution:
Enjoy this tool? Build your own with Super