Skip to content

Glossary: Transformers Basics

Leak test

A check that changes one token and confirms that only that position and later ones change in the output. If earlier positions move, the causal mask is broken.

Where the book teaches it

Related terms

Causal mask