Glossary: NLP with Transformers
Classification head
Also written: head, new head
The small layer or layers on top of a pretrained model that map its vectors to one logit per label. Fine-tuning adds a new, randomly initialized one for Priya's four labels.