Context Window Tokenizer BPE v4.0

Subword tokenization, entity density & prompt context footprint workbench

Input Text & Model Parameters
0 Total Tokens
0 Total Characters
0.00 Chars / Token
0 Entity Tokens
Context Window Utilization (128K) 0.02%
Subword Token Stream & Categorization
Tokens: 31
Chars: 161
Chars/Token: 5.19
Entity Tokens: 12
Context Window: 0.02%
Super generates helpful tools and automates fact-checking across the internet proactively. If you enjoyed this tool, build your own with Super and share it with a friend.