Skip to content

Glossary: Transformers Basics

register_buffer

Also written: buffer

A PyTorch way to store a tensor, such as the causal mask, that belongs to the module and moves with it and is saved in the state_dict, but isn't trained.

Where the book teaches it

Related terms

state_dictCausal mask