Skip to content

Glossary: Fine-tuning LLMs

Base model

Also written: base version

A model that has only been pretrained, so it continues text instead of following requests. For small fine-tuning datasets it is usually better to start from the instruct version of the model instead.

Where the book teaches it

Related terms

Instruct model