Red-teaming

Also written: red-team

Attacking your own system, with permission, to find weaknesses before someone else does. For an LLM app, it means running a fixed set of attack cases several times and scoring them by code.