Glossary: Serving LLMs at Scale
Perplexity
Also written: PPL
A measure of how surprised a model is by real text; lower is better. It is a quick way to compare two versions of the same model, such as 8-bit against 4-bit.
Glossary: Serving LLMs at Scale
Also written: PPL
A measure of how surprised a model is by real text; lower is better. It is a quick way to compare two versions of the same model, such as 8-bit against 4-bit.