Skip to content

Glossary: Fine-tuning LLMs

Chat template

Also written: chat templates, apply_chat_template

The rules stored with the tokenizer that turn a list of messages into one token sequence with special tokens marking each turn. Training, evaluation and serving must all use the same one.

Where the book teaches it

Related terms

Generation promptChatMLMessagesSpecial tokens