Glossary: Fine-tuning LLMs

Linear schedule

A learning-rate schedule that falls in a straight line to 0 by the end of training. It is the common default, applied after an initial warmup.