Glossary: Fine-tuning LLMs

Overfitting

Also written: overfit

Fitting the training examples better and better while getting worse on new ones. The sign is validation loss rising while training loss keeps falling.