Skip to content

Glossary: Fine-tuning LLMs

Validation loss

Also written: eval_loss

The loss on the validation set, which the model never trains on. If it rises while training loss falls, the model is overfitting.

Where the book teaches it

Related terms

Training lossOverfittingCheckpoint