Vocabulary

Also written: vocab_size, vocab

The fixed list of tokens a tokenizer can produce, each with a numeric ID. BERT's uncased tokenizer has 30,522 tokens, while a tokenizer trained from scratch on a small dataset may have only a few thousand.