Skip to content

Glossary: Fine-tuning LLMs

Masking (masked tokens)

Also written: masked, mask, -100

Giving prompt tokens the label -100 so the loss ignores them. This way the model learns only to write the answer, not the email.

Where the book teaches it

Related terms

CompletionPrompt and completion formatPacking