Skip to content

Glossary: NLP with Transformers

Classification head

Also written: head, new head

The small layer or layers on top of a pretrained model that map its vectors to one logit per label. Fine-tuning adds a new, randomly initialized one for Priya's four labels.

Where the book teaches it

Related terms

LogitsFine-tuningLoad report