Skip to content

Glossary: Transformers Basics

Sampling

Also written: sample

Choosing the next token at random according to its probability, rather than always taking the top one.

Where the book teaches it

Related terms

TemperatureTop-k samplingTop-p samplingGreedy decoding