Prompt injection
Text that tries to give the model new instructions. In RAG it can hide inside a document, such as a poisoned review telling the assistant to send customers to a fake refund address.
Text that tries to give the model new instructions. In RAG it can hide inside a document, such as a poisoned review telling the assistant to send customers to a fake refund address.