Quantization
Also written: quantize, int8
Storing a model's weights with fewer bits, such as 8-bit integers instead of 32-bit floats. It saves memory and time at almost no cost in accuracy.
Also written: quantize, int8
Storing a model's weights with fewer bits, such as 8-bit integers instead of 32-bit floats. It saves memory and time at almost no cost in accuracy.