26 August 2026
Anthropic's Claude uses unusually small token vocabulary
First reported
TLDR AI ran this on .
- Claude's tokenizer, the system that breaks text into units the model processes, contains roughly 15,000 entries compared to industry norms of much larger sizes.
- Researchers analyzing Claude speculate Anthropic chose this constraint intentionally, possibly to work around technical limitations in how the model's output layer functions.
