Glossary: Running Open Models Locally
BF16
Also written: F16, bfloat16, 16-bit
Two 16-bit number formats (2 bytes per number) in which models are usually trained. They are the original precision against which quantized files are compared.
Glossary: Running Open Models Locally
Also written: F16, bfloat16, 16-bit
Two 16-bit number formats (2 bytes per number) in which models are usually trained. They are the original precision against which quantized files are compared.