Glossary: Fine-tuning LLMs

Distillation

Training a small model on a bigger model's outputs. Check the provider's terms first, since some forbid using outputs to train other models.