Parameter

Also written: parameters

One learned number in a model. It takes 2 bytes in 16-bit formats, so weights need about 2 GB per billion parameters.