Vocabulary

Also written: vocab, vocabulary size

All the tokens a tokenizer knows. Ours has 72 characters at first; GPT-2 has 50,257 tokens.