Glossary: Application and Credential Attacks, and AI Risks

jailbreaking

Also written: jailbreak, jailbreaks

Tricking an AI into breaking its own safety rules so it produces content it was built to refuse, using tricks like role play or hypotheticals. Its goal is forbidden content, not control of the application's task.