Glossary: LLMs in Production

Idempotency key

Also written: Idempotency-Key, idempotency keys

A random ID the client makes for each new request and resends when repeating it, sent in an Idempotency-Key header. The server does the work once per key and gives repeats the saved result.