Glossary: Application and Credential Attacks, and AI Risks

model manipulation

Changing the model itself, its file, its weights, its settings or its system prompt, so it behaves as the attacker wants. An example is someone editing Kettle Helper's system prompt so it says refunds are impossible.