Skip to content

Glossary: NLP with Transformers

RoBERTa / XLM-RoBERTa

Also written: RoBERTa, xlm-roberta-base

BERT-family encoder models. RoBERTa uses `<s>` and `</s>` as special tokens, and XLM-RoBERTa is multilingual.

Where the book teaches it

Related terms

BERTSpecial tokens