Skip to content

Glossary: LLMs in Production

Moderation model

Also written: moderation endpoint

A cheap classifier that scores text for harm categories such as violence and harassment. The scores are probabilities, so set thresholds from your own traffic.

Where the book teaches it

Related terms

Prompt injection