Skip to content

Glossary: Fine-tuning LLMs

Repetition penalty

Also written: repetition_penalty

A `generate` setting that makes already-used tokens less likely. It failed here because it also punishes words a reply must reuse, such as customer names.

Where the book teaches it

Related terms

Repetition loop