Special tokens
Also written: [CLS], [SEP], [MASK], [PAD], end-of-text token
Reserved tokens that mark structure rather than text, such as GPT-2's end-of-text token, BERT's [CLS], [SEP], [MASK] and [PAD], and chat models' turn markers.
Also written: [CLS], [SEP], [MASK], [PAD], end-of-text token
Reserved tokens that mark structure rather than text, such as GPT-2's end-of-text token, BERT's [CLS], [SEP], [MASK] and [PAD], and chat models' turn markers.