Skip to content

Glossary: AI Security and Guardrails

Moderation model

Also written: moderation, omni-moderation-latest

A classifier that scores text for harmful content such as threats, harassment and self-harm. It does not detect prompt injection; the fake tracking page scored zero everywhere.

Where the book teaches it

Related terms

Classifier (input, output)Prompt injection