Skip to content

Glossary: Fine-tuning LLMs

Attention mask

A list of 1s and 0s that tells the model which tokens are real and which are padding. `apply_chat_template` returns it alongside `input_ids`.

Where the book teaches it

Related terms

Left paddingChat template