Glossary: Transformers Basics

Encoder-decoder

Also written: encoder-decoder model, sequence-to-sequence

A transformer where an encoder reads the input with full attention and a decoder writes the output with causal attention, linked by cross-attention. T5 is an example, good for translation and summarization.