Glossary: Application and Credential Attacks, and AI Risks

prompt injection

Putting instructions into an AI application's input so the model follows them instead of the developer's. It works because an LLM gets instructions and data as one stream of text, and the danger grows with the tools the AI can use.