Glossary: Transformers Basics
A 2019 encoder-decoder model that treats every task as text in, text out, pretrained by filling in hidden spans of text.
Encoder-decoderSentencePiece