Glossary: LLMs in Production

Redis

Also written: redis-cli, INCR, EXPIRE, SET NX EX

A shared in-memory data store. With several replicas, counters, idempotency keys and breaker state move to it: INCR counts, EXPIRE resets a key, and SET ... NX EX sets a key only if absent, with a lifetime.