Skip to content

Glossary: Fine-tuning LLMs

max_length

Also written: max_seq_length, length limit

The training length limit in tokens; longer examples are cut off, possibly mid-answer. Measure your example lengths first so nothing important is truncated.

Where the book teaches it

Related terms

PackingBatch size