Skip to content

Glossary: Fine-tuning LLMs

System message

Also written: system prompt

The first message in a conversation (role `system`), giving the model its instructions. Use the same system message in training and in use, because the model sees it as part of the text.

Where the book teaches it

Related terms

MessagesChat template