Transformer
The network design inside ChatGPT-style models, introduced in 2017's 'Attention Is All You Need'. It stacks blocks of attention and an MLP, with residual connections and layer norm.
Where the book teaches it
Related terms
AttentionTransformer blockResidual connectionLayer normalization