Skip to content

Glossary: Transformers Basics

Greedy decoding

Also written: greedy

Always choosing the single most likely next token. It gives the same output every time and often loops.

Where the book teaches it

Related terms

SamplingTemperature