Glossary: Fine-tuning LLMs
A training-log value giving the size of the gradient. A sudden jump warns of instability.
GradientLearning rate