Glossary: NLP with Transformers
Parameters (weights)
Also written: parameters, weights, num_parameters
The numbers a model learns during training. DistilBERT has about 67 million, and the small from-scratch model has 682,884.
Glossary: NLP with Transformers
Also written: parameters, weights, num_parameters
The numbers a model learns during training. DistilBERT has about 67 million, and the small from-scratch model has 682,884.