Skip to content

Glossary: Embeddings and Vector Search

float32, float16, int8

Also written: float32, float16, int8, float

Number formats for each vector value: float32 uses 4 bytes, float16 2 bytes and int8 1 byte. Smaller formats save memory with little recall loss.

Where the book teaches it

Related terms

quantizationNumPy array