Skip to content

Glossary: Fine-tuning LLMs

Greedy decoding

Also written: do_sample=False

Always picking the likeliest next token, which makes output repeatable. In `generate` it is set with `do_sample=False`.

Where the book teaches it

Related terms

Repetition loopTemperature