Skip to content

Glossary: Fine-tuning LLMs

Repetition loop

Also written: loops

A model repeating the same line until `max_new_tokens` runs out. It is common in small, undertrained models, as in the tuned model's repeated "Kettle & Crane" sign-offs.

Where the book teaches it

Related terms

Repetition penaltyGreedy decodingEnd-of-sequence (EOS) token