Skip to content

Glossary: NLP with Transformers

Parameters (weights)

Also written: parameters, weights, num_parameters

The numbers a model learns during training. DistilBERT has about 67 million, and the small from-scratch model has 682,884.

Where the book teaches it

Related terms

PretrainingSafetensors