Skip to content

Glossary: Transformers Basics

Base model

Also written: base

A pretrained model that only continues text and does not follow instructions. Asked to write a blurb for a mug, it may just continue with more requests.

Where the book teaches it

Related terms

PretrainingInstruction tuning (SFT)Fine-tuning