Glossary: Fine-tuning LLMs
Also written: train loss
The average loss on the batches the model just learned from, logged every few steps.
Validation lossOverfitting