Glossary: Transformers Basics
A subword tokenization method, a close cousin of BPE, used by BERT with about 30,000 tokens.
BPE (byte pair encoding)BERT