Skip to content

Glossary: Fine-tuning LLMs

Left padding

Also written: padding_side="left", padding side

Padding prompts at the start so every prompt in a batch ends exactly where generation begins. Batched generation gives garbled output without it.

Where the book teaches it

Related terms

Attention mask