Completion
The part of a training example the model should write, such as the assistant's JSON answer. The loss counts only these tokens.
Where the book teaches it
Related terms
Prompt (in a dataset)Masking (masked tokens)Prompt and completion format