Skip to content

Glossary: Transformers Basics

Logits

Also written: logit

The raw scores a model outputs, one per vocabulary token, before softmax turns them into probabilities.

Where the book teaches it

Related terms

TemperatureLanguage-model head