Encoder-only model
Also written: encoder
A transformer whose blocks use full attention, so every token sees text on both sides. It suits understanding tasks such as classifying and tagging, like BERT.
Also written: encoder
A transformer whose blocks use full attention, so every token sees text on both sides. It suits understanding tasks such as classifying and tagging, like BERT.