Skip to content

Glossary: Fine-tuning LLMs

Packing

Also written: packing=True

Joining several short examples into one `max_length` block so no time is spent on padding. It's useful for many short examples on a GPU.

Where the book teaches it

Related terms

max_lengthMasking (masked tokens)