Skip to content

Glossary: Fine-tuning LLMs

Generation prompt

Also written: add_generation_prompt

The text that cues the model's turn, such as `<|im_start|>assistant` and a new line. `add_generation_prompt=True` adds it.

Where the book teaches it

Related terms

Chat template