Skip to content

Glossary: Transformers Basics

Language model

A model that takes the text so far and gives a probability for every possible next token. Writing means sampling a token, appending it and repeating.

Where the book teaches it

Related terms

TokenSampling