Skip to content

Glossary: Transformers Basics

Chat template

Also written: ChatML

The format that turns a conversation into one text, using special tokens that mark where each speaker's turn starts and ends. Using the wrong template is a common reason a fine-tuned chat model performs badly.

Where the book teaches it

Related terms

Special tokensPrompt