Skip to content

Glossary: Fine-tuning LLMs

Training loss

Also written: train loss

The average loss on the batches the model just learned from, logged every few steps.

Where the book teaches it

Related terms

Validation lossOverfitting