Glossary: Running Open Models Locally
Tensor
One table of weights in a model file. The `S`, `M`, `L` letters in quantization names say how many of the most sensitive tensors keep higher precision.
Glossary: Running Open Models Locally
One table of weights in a model file. The `S`, `M`, `L` letters in quantization names say how many of the most sensitive tensors keep higher precision.