Glossary: Deep Learning Basics
bfloat16
A 16-bit number format with float32's range, supported on newer GPUs and CPUs. It needs no gradient scaler for mixed precision.
Glossary: Deep Learning Basics
A 16-bit number format with float32's range, supported on newer GPUs and CPUs. It needs no gradient scaler for mixed precision.